-- Logs begin at Sun 2022-09-11 14:32:57 UTC, end at Sun 2022-09-11 15:38:00 UTC. -- Sep 11 15:03:49.015474 dv-cinder-839768-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 15:03:49.024850 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 15:03:49 2022] *** Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: nodename: dv-cinder-839768-7-iscsi Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: machine: x86_64 Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: clock source: unix Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: pcre jit disabled Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: detected number of CPU cores: 4 Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: current working directory: / Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: detected binary path: /usr/bin/uwsgi-core Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: your processes number limit is 47680 Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: your memory page size is 4096 bytes Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: detected max file descriptor number: 2048 Sep 11 15:03:49.026659 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: lock engine: pthread robust mutexes Sep 11 15:03:49.027517 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: thunder lock: enabled Sep 11 15:03:49.027517 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 15:03:49.027517 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 15:03:49.065504 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: Python main interpreter initialized at 0x5647d94539c0 Sep 11 15:03:49.065504 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: python threads support enabled Sep 11 15:03:49.065504 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: your server socket listen backlog is limited to 100 connections Sep 11 15:03:49.065504 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: your mercy for graceful operations on workers is 90 seconds Sep 11 15:03:49.065936 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 15:03:49.065936 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: *** Operational MODE: preforking *** Sep 11 15:03:49.066216 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: *** uWSGI is running in multiple interpreter mode *** Sep 11 15:03:49.066216 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: spawned uWSGI master process (pid: 105706) Sep 11 15:03:49.066492 dv-cinder-839768-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 11 15:03:49.067595 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: spawned uWSGI worker 1 (pid: 105707, cores: 1) Sep 11 15:03:49.067595 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: spawned uWSGI worker 2 (pid: 105708, cores: 1) Sep 11 15:03:49.067595 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 15:03:49.724582 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 15:03:49.753539 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 15:03:50.815011 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 15:03:50.815011 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: from cryptography.utils import int_from_bytes Sep 11 15:03:50.815704 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 15:03:50.815704 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: from cryptography.utils import int_from_bytes Sep 11 15:03:50.863814 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 15:03:50.863814 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: from cryptography.utils import int_from_bytes Sep 11 15:03:50.864607 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 15:03:50.864607 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: from cryptography.utils import int_from_bytes Sep 11 15:03:53.497266 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 15:03:53.497856 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 15:03:53.498043 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 15:03:53.498404 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 15:03:53.498656 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 15:03:53.499043 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.499369 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.499684 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.499999 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.500323 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.500628 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.500945 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.501291 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.501623 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.501878 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.502195 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.502511 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-7-iscsi {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.502834 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.503140 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.503443 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.503755 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.504055 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.504496 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.504803 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.505340 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.506575 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.506575 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.506575 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.506905 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.507005 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.507282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.507597 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.507901 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.508224 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.508524 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.508922 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-7-iscsi {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.509269 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.509579 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.509890 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.510297 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.510611 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.510984 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.511233 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.511550 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.511671 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 15:03:53.512187 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.512272 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 15:03:53.512363 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.512438 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.512511 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 15:03:53.512771 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.512891 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 15:03:53.513063 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.513310 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 15:03:53.513389 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.513529 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.513751 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.513892 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.513982 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.514151 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.514269 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.514469 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.514605 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.514816 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.514914 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.515110 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.515306 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.515448 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.515609 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.515858 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.516008 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.516190 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.516372 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.516507 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.516675 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.516830 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.516975 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.517109 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.517294 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-7-iscsi {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.517406 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.517508 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.517598 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.517680 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.517758 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.517906 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.517998 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.518220 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.518354 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.518588 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.518736 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.518849 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.518939 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.519108 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.519273 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.519418 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.519699 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.519889 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.520104 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.520352 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.520452 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.520543 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.520624 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.520709 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.520927 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.521092 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.521266 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.521370 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.521682 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.521876 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.521997 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.522124 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.522244 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.522406 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.522498 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.522623 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.522837 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.522971 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.523138 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.523285 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-7-iscsi {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.523413 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.523637 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.523771 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.523921 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.524017 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.524242 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.524389 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.524593 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.524732 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.524904 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.525055 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.525255 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.525424 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.525569 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.525704 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.525846 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.525986 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.526164 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.526363 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.526478 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.526600 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.526715 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.526861 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.527023 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.527202 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.527307 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.527534 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.527686 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.527778 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.527871 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.528174 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.528367 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.528498 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.528590 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.528696 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.528838 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.528982 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.529165 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.529321 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.529496 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.529644 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.529770 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.529868 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.530038 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.530171 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.530360 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.530589 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.530739 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.530942 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.531091 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.531238 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.531382 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.531555 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.531694 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.531834 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.532049 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.532195 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.532359 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.532517 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.532517 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.532789 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.532949 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.533102 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.533362 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.533508 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.533652 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.533791 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.533946 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.534090 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.534244 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.534379 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.534504 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.534649 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.534804 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.534948 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.535167 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.535325 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.535470 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.535741 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.535889 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.535889 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.536171 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.536324 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.536466 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.536660 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.536816 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.536963 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.537219 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.537370 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.537501 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.537690 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.537826 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.537980 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.537980 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.538271 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.538424 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.538576 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.538713 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.538976 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.539120 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.539221 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.539303 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.539414 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.539585 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.539696 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.539810 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.539952 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.540093 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.540213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.540307 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.540472 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.540602 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.540760 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.540909 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.541123 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.541336 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.541435 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.541540 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.541740 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.541837 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.542044 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.542209 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.542417 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.542618 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.542768 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.542861 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.543022 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.543144 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.543363 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.543506 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.543630 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.543725 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.543965 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.544114 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.544282 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.544415 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.544577 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.544696 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.544854 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.544944 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.545164 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.545283 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.545502 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.545668 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.545777 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.545857 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.546072 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.546190 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.546381 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.546562 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.546711 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.546804 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.546998 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.547152 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.547296 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.547418 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.547625 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.547760 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.547933 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.548155 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.548318 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.548527 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.548701 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.548853 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.548988 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.549194 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.549358 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.549503 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.549657 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.549811 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.549953 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.550094 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.550237 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.550399 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.550543 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.550697 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.550839 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.550983 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.551127 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.551293 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.551438 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.551577 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.551665 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.551896 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.552005 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.552198 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.552286 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.552503 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.552600 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.552819 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.552905 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.553127 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.553280 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.553453 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.553572 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.553756 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.553887 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.554069 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.554177 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.554395 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.554487 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.554709 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.554846 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.555032 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.555143 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.555341 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.555479 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.555653 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.555757 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.555971 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.556116 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.556272 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.556389 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.556582 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.556695 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.556888 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.556977 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.557211 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.557301 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.557516 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.557641 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:03:53.557817 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.557908 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.558130 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.558287 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.558427 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.558589 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.558745 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.558939 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.559090 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.559277 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.559393 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.559606 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.559739 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.559946 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.560105 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.560238 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.560357 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.560553 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.560709 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.560871 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.560965 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.561199 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.561330 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.561488 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.561633 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.561804 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.561971 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.562123 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.562313 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.562483 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.562638 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.562790 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.562998 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.563117 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.563317 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.563461 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.563621 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.563758 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.563925 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.564076 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.564243 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.564361 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.564552 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.564707 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.564853 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.565059 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.565239 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.565449 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.565575 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.565758 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.565845 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.566078 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.566167 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.566386 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.566479 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.567141 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.567256 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.567341 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.567420 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.567531 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.567673 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.567875 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.568032 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.568175 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.568343 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.568440 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.568563 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.568648 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.568736 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.568915 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.569093 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.569283 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.569422 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.569565 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.569798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.569943 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.570080 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.570233 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.570385 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.570485 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.570687 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.570785 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.570991 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.571148 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.571291 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.571411 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.571581 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.571692 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.571900 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.572026 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.572206 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.572371 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.572525 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.572653 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.572783 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.572938 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.573090 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.573283 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.573428 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.573630 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.573773 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.573974 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.574124 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.574306 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.574399 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.574640 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.574786 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.574931 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.575085 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.575229 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.575372 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.575538 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.575681 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.575822 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.575973 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.576139 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.576302 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.576449 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.576543 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.576759 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.576922 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.577060 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.577215 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.577388 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.577522 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.577710 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.577846 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.578013 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.578189 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.578336 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.578529 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.578696 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.578856 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.578990 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.579167 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.579257 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.579472 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.579573 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.579791 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.579889 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.580124 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.580214 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.580446 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.580550 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.580765 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.580899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.581078 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.581227 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.581419 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.581533 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.581729 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.581819 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.582040 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.582138 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.582514 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.582673 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.582814 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.582958 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.583100 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.583221 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.583351 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.583491 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.583613 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.583725 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.583867 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.584055 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.584183 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.584386 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.584550 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.584742 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.584842 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.585047 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.585170 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.585409 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.585561 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.585731 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.585828 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.586067 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.586203 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.586370 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.586500 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.586686 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.586844 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.586993 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.587143 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.587295 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.587448 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.587654 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.587788 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.587902 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.588114 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.588285 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.588440 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.588537 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.588764 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.588873 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.589072 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.589239 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.589420 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.589587 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.589734 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.590244 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.590388 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.590550 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.590690 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.590838 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.591008 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.591161 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.591284 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.591416 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.591530 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.591825 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.592014 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.592152 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.592256 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.592428 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.592538 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.592743 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.592883 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.593062 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.593257 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.593396 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.593497 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.593686 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.593791 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.593979 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.594115 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.594286 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.594429 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.594574 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.594778 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.594882 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.595116 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.595209 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.595473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.595626 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.595779 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.595902 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.596082 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.596187 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.596392 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.596544 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.596715 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.596861 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.597017 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.597166 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.597355 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.597494 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.597669 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.597813 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.597997 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.598171 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.598412 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.598555 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.598680 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.598821 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.599046 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.599189 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.599448 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.599553 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.599634 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.599714 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.599862 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.600012 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.600173 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.600275 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.600467 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.600641 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.600782 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.600966 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.601113 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.601366 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.601507 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.601668 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.601785 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.601976 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.602085 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.602291 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.602384 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.602710 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.602882 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.603067 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.603222 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.603371 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.603514 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.603654 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.603805 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.604020 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.604190 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.604352 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.604514 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.604689 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.604839 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.605022 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.605232 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.605382 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.605530 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.605686 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.605832 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.605990 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.606153 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.606293 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.606431 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.606568 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.606702 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.606848 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.607006 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.607150 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.607293 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.607449 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.607594 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.607756 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.607899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.608028 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.608103 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.608262 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.608382 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.608565 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.608687 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.608870 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.608992 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.609224 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.609311 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.609517 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.609662 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.609818 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.609938 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.610127 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.610248 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.610430 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.610551 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.610757 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.610890 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.611058 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.611221 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.611367 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.611567 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.611662 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.611895 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.612036 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.612200 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.612299 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.612523 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.612640 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.612873 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.613025 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.613252 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.613405 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.613559 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.613697 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.613898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.614060 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.614194 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.614284 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.614516 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.614626 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.614820 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.614985 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.615135 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.615245 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.615410 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.615507 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.615723 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.615886 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.616023 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.616173 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.616313 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.616526 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.616652 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.616859 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.616963 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.617226 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.617376 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.617535 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.617700 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.617866 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.617993 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.618136 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.618280 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.618436 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.618576 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.618753 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.618896 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.619042 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.619190 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.619343 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.619532 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.619679 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.619918 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.620014 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.620222 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.620313 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.620522 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.620612 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.620837 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.621010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.621124 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.621248 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.621462 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.621572 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.621771 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.621898 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.622074 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.622233 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.622371 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.622508 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.622664 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.622797 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.622973 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.623124 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.623283 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.623458 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.623580 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.623888 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.624041 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.624192 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.624375 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.624493 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.624712 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.624810 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.625053 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.625210 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.625404 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.625541 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.625711 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.625871 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.626026 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.626183 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.626334 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.626482 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.626622 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.626744 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.626932 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.627041 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.627232 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.627380 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.627523 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.627714 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.627839 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.628051 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.628173 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.628396 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.628508 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.628696 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.628810 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.628989 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.629084 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.629369 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.629494 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.629673 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.629776 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.629994 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.630117 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.630302 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.630455 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.630650 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.630815 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.630940 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.631062 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.631168 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.631289 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.631512 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.631639 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.631817 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.631942 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.632177 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.632332 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.632483 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.632640 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.632785 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.632921 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.633101 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.633301 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.633440 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.633557 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.633745 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.633860 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.634059 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.634224 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.634360 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.634532 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.634673 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.634871 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.634979 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.635201 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.635298 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.635544 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.635644 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.635850 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.635939 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.636156 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.636252 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.636463 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.636551 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.636770 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.636859 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.637086 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.637197 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.637433 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.637518 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.637755 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.637859 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.638061 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.638166 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.638362 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.638454 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.638667 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.638743 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.638972 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.639049 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.639279 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.639361 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.639586 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.639671 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.639891 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.639969 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.640202 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.640299 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.640507 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.640616 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.640841 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.640941 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.641119 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.641298 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.641509 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.641674 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.641820 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.641979 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.642156 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.642304 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.642505 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.642676 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.642808 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.643056 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.643143 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.643431 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.643516 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.643785 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.643894 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.644110 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.644204 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.644436 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.644681 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.644781 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.645066 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.645286 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.645405 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.645710 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.645820 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.646056 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.646373 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.646487 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.646724 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.646811 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.647054 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.647145 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.647389 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.647549 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.647739 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.647866 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.648078 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.648280 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.648412 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.648655 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.648744 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.649068 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.649198 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.649436 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.649525 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.649754 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.650064 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.650320 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.650423 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.650668 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.650933 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.651029 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.651347 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.651457 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.651675 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.651797 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.652022 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.652313 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.652403 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.652615 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.652801 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.652962 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.653179 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.653323 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.653630 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.653730 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.653946 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.654260 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.654374 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.654655 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.654741 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.654998 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.655088 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.655387 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.655481 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.655694 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.655939 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.656034 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.656318 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.656519 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.656640 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.656977 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.657324 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.657466 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.657632 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.657880 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.657967 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.658270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.658531 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.658629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.658955 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.659275 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.659372 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.659616 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.659865 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.659970 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.660295 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.660395 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.660697 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.661052 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.661174 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.661406 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.661636 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.661746 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.662073 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.662182 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.662426 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.662518 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.662763 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.662859 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.663115 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.663292 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.663449 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.663564 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.663772 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.663873 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.664092 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.664282 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.664430 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.664530 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.664719 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.664838 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.665057 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.665229 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.665405 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.665561 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.665728 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.665838 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.666039 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.666138 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.666347 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.666467 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.666677 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.666800 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.666991 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.667121 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.667301 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.667442 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.667616 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.667775 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.667989 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.668132 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.668272 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.668491 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.668648 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.668804 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.668948 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.669086 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.669264 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.669374 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.669575 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.669749 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.669889 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.669987 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.670181 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.670291 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.670492 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.670628 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.670812 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.670949 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.671120 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.671279 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.671448 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.671601 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.671718 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.672034 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.672180 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.672408 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.672584 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.672732 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.672862 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.672982 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.673125 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.673307 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.673454 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.673595 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.673737 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.673959 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.674104 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.674245 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.674389 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.674533 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.674703 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.674844 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.674989 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.675134 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.675262 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.675397 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.675502 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.675704 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.675809 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.676026 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.676160 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.676391 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.676542 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.676719 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.676864 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.677031 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.677190 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.677390 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.677615 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.677728 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.677932 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.678029 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.678247 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.678352 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.678571 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.678664 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.678896 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.678987 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.679254 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.679401 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.679529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.679714 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.679845 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.679917 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.680133 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.680268 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.680439 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.680582 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.680773 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.680940 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.681164 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.681361 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.681597 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.681845 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.681950 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.681950 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.682259 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.682401 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.682531 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.682688 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.682913 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.683004 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.683192 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.683289 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.683411 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.683526 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.683776 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.684031 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.684143 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.684280 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.684409 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.684497 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.684694 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.684806 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.685009 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.686456 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.686562 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.686686 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.686810 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.687010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.687150 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.687240 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.687352 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.687680 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.687827 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.688023 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.688179 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.688318 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.688472 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.688598 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.688850 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.688850 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.689093 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.689193 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.689342 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.689512 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.689702 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.689919 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.690117 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.690191 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.690330 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.690330 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.690687 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.690919 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.691159 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.691330 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.691423 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.691545 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.691812 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.691812 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.692052 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.692292 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.692471 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.692573 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.692666 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.692748 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.692924 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.693043 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.693301 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.693579 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.693701 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.693806 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.693877 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.693956 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.694088 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.694192 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.694392 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.694578 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.694578 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.694761 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.694896 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.695058 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.695145 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.695264 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.695354 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.695465 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.695562 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.695696 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.695855 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.695977 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.696099 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.696237 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.696385 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.696525 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.696668 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.696811 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.696962 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.697068 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.697248 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.697248 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.697403 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.697567 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.697664 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.697876 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.698002 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.698185 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.698324 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.698485 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.698623 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.698793 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.698930 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.699131 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.699259 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.699397 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.699523 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.699708 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.699865 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.700040 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.700199 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.700345 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.700502 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.700661 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.700820 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.700964 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.701102 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.701380 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.701550 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.701702 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.701845 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.701985 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.702112 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.702298 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.702463 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.702611 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.702758 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.702935 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.703090 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.703248 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.703408 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.703548 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.703690 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.703833 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.703978 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.704146 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.704346 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.704497 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.704639 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.704781 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.704921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.705074 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.705299 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.705456 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.705611 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.705747 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.705869 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.706018 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.706149 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.706343 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.706487 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.706636 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.706778 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.706939 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.707031 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.707321 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.707507 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.707689 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.707856 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.708171 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.708320 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.708498 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.708649 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.708825 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.708997 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.709127 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.709304 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.709446 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.709589 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.709779 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.709948 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.710228 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.710372 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.710566 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.710702 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.710900 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.711026 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.711254 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.711384 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.711565 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.711722 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.711919 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.712051 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.712168 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.712297 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.712475 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.712631 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.712769 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.712956 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.713104 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.713298 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.713441 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.713601 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.713747 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.713903 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.714048 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.714201 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.714355 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.714552 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.714702 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.715227 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.715346 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.715527 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.715624 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.715832 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.715944 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.716135 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.716238 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.716446 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.716542 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.716749 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.716846 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.717056 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.717188 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.717384 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.717488 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.717692 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.717779 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.718002 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.718135 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.718313 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.718406 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.718625 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.718727 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.718935 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.719023 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.719240 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.719385 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.719533 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.719639 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.719849 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.720003 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.720149 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.720298 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.720459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.720612 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.720772 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.720948 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.721083 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.721468 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.721616 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.721775 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.721919 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.722271 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.722380 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.722615 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.722727 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.722971 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.723135 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.723358 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.723479 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.723678 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.723818 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.723984 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.724090 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.724288 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.724416 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.724596 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.724719 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.724920 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.725078 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.725254 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.725418 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.725565 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.725668 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.725861 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.726021 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.726164 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.726300 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.726470 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.726602 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.726776 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.727040 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.727195 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.727298 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.727444 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.727666 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.727842 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.727983 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.728261 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.728356 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.728571 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.728723 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.728877 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.729003 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.729185 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.729441 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.729568 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.729852 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.729957 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.730137 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.730221 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.730455 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.730547 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.730843 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.730991 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.731137 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.731368 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.731477 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.731564 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.731676 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.731843 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.732010 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.732212 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.732466 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.732559 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.732671 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.732855 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.732959 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.733243 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.733706 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.733872 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.734028 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.734028 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.734248 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.734380 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.734546 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.734730 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.734955 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.735134 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.735219 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.735308 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.735480 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.735624 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.735805 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.736014 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.736196 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.736436 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.736625 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.736782 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.736873 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.737019 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.737114 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.737374 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.737526 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.737707 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.737866 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.738029 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.738119 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.738386 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.738501 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.738694 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.738819 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.739004 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.739146 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.739303 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.739459 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.739616 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.739726 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.739934 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.740028 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.740242 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.740451 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.740532 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.740699 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.740835 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.741059 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.741234 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.741412 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.741551 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.741748 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.741844 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.742042 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.742230 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.742329 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.742566 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.742689 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.742880 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.743004 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.743215 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.743325 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.743517 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.743617 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.743823 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.744118 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.744217 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.744419 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.744505 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.744728 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.744829 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.745035 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.745287 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.745422 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.745530 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.745631 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.745845 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.745993 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.746141 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.746236 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.746493 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.746622 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.746852 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.746985 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.747157 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.747254 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.747470 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.747557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.747777 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.747914 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.748101 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.748209 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.748450 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.748617 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.748721 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.748835 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.749034 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.749223 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.749372 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.749505 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.749714 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.749902 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.750046 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.750138 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.750291 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.750510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.750698 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.750789 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.750891 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.751073 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.751201 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.751387 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.751518 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.751707 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.751846 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.752086 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.752204 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.752437 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.752716 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.752862 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.752963 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.753045 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.753178 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.753465 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.753593 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.753694 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.753894 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.754030 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.754157 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.754363 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.754554 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.754755 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.754901 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.755121 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.755238 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.755380 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.755573 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.755688 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.755881 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.755972 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.756195 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.756303 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.756505 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.756815 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.757000 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.757205 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.757445 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.757538 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.757713 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.757903 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.758060 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.758167 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.758381 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.758504 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.758690 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.758873 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.759016 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.759117 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.759341 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.759495 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.759699 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.759853 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.760056 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.760181 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.760354 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.760572 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.760702 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.760807 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.761038 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.761269 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.761388 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.761591 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.761694 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.761826 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.761925 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 15:03:53.762143 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.762474 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.762823 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.763190 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.763531 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.763872 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.764221 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.764539 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.764877 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.765243 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.765549 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.765877 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.766219 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.766546 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.766891 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.767242 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.767546 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.767851 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.768176 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.768514 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.768850 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.769206 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.769556 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.769880 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.770192 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.770555 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.770926 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.771288 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.771631 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.771965 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.772286 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.772619 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.772967 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.773320 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.773648 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.773995 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.774348 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.774704 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.775068 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.775428 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.775787 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.776086 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.776406 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.776736 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.777071 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.777431 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.777759 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.778078 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.778467 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.778714 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.779025 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.779379 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.779711 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.780121 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.780445 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.780778 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.781091 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.781436 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.781746 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.782058 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.782375 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.782691 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.783018 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.783344 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.783656 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.784027 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.784376 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.784777 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.785113 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.785627 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.786008 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.786355 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.786754 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.787111 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:03:53.787374 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 15:03:53.918152 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO dbcounter [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Registered counter for database nova_api Sep 11 15:03:53.941698 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_db.sqlalchemy.engines [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:03:53.948766 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writer thread running {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:03:53.949905 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Registered counter for database nova_api Sep 11 15:03:53.971883 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:03:53.979072 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:03:54.006138 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.context [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e60759ca-dd72-43ee-a0ab-eedd3bf86111(cell1) {{(pid=105707) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 15:03:54.010186 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:03:54.010662 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:03:54.012241 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:03:54.012979 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:03:54.013482 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:03:54.015449 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:03:54.017529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO dbcounter [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Registered counter for database nova_cell0 Sep 11 15:03:54.021874 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO dbcounter [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Registered counter for database nova_cell1 Sep 11 15:03:54.029679 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_db.sqlalchemy.engines [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:03:54.032105 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_db.sqlalchemy.engines [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:03:54.036758 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writer thread running {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:03:54.039329 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.context [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e60759ca-dd72-43ee-a0ab-eedd3bf86111(cell1) {{(pid=105708) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 15:03:54.043702 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:03:54.044312 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:03:54.046061 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:03:54.046857 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:03:54.047332 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:03:54.049424 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:03:54.051556 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Registered counter for database nova_cell0 Sep 11 15:03:54.056053 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Registered counter for database nova_cell1 Sep 11 15:03:54.064063 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:03:54.067458 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:03:54.072947 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:03:54.076075 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:03:54.174970 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writer thread running {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:03:54.185753 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO dbcounter [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Registered counter for database nova_cell0 Sep 11 15:03:54.193650 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_db.sqlalchemy.engines [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:03:54.198506 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writer thread running {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:03:54.244148 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Registered counter for database nova_cell0 Sep 11 15:03:54.252004 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:03:54.258412 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:03:54.539201 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: WARNING keystonemiddleware.auth_token [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 15:03:54.546818 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: WARNING keystonemiddleware.auth_token [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 15:03:54.621519 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 15:03:54.630307 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 15:03:54.892142 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: WARNING keystonemiddleware.auth_token [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 15:03:54.898518 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: WARNING keystonemiddleware.auth_token [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 15:03:54.904421 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5647d94539c0 pid: 105707 (default app) Sep 11 15:03:54.906749 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:03:54.908066 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001929 Sep 11 15:03:54.908457 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Sun Sep 11 15:03:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:03:55.009917 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 15:03:55.017049 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-c85fba79-5c76-4a30-b06f-840699673174 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 15:03:55.022904 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647d94539c0 pid: 105708 (default app) Sep 11 15:05:20.527440 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:20.529324 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002275 Sep 11 15:05:20.530299 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:20.548906 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:20.551006 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell0:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:20.551849 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell1:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:20.553291 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell0:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:21.634769 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-43226f2a-772d-4453-8ce2-2370020d4926 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:21.672277 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-43226f2a-772d-4453-8ce2-2370020d4926 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.134167 Sep 11 15:05:21.672979 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1292 bytes} [Sun Sep 11 15:05:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:05:24.621026 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:24.622550 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-35531be8-9b54-45c3-a96b-1e6a4e55d85a None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 11 15:05:24.623079 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:25.178567 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-78328d55-de57-4f1e-8a0e-8e64a37851db admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "swap": 0}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:25.230049 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-78328d55-de57-4f1e-8a0e-8e64a37851db admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.596291 Sep 11 15:05:25.230950 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:05:25.698540 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-0c01c525-6b58-40f6-b955-bec440ce0c09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:25.709925 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=3 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:25.711519 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell0:SELECT=3 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:25.712990 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell1:SELECT=3 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:25.714155 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:25.824297 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-0c01c525-6b58-40f6-b955-bec440ce0c09 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.581491 Sep 11 15:05:25.825354 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 15:05:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:05:28.873553 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-78328d55-de57-4f1e-8a0e-8e64a37851db admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:28.874575 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-78328d55-de57-4f1e-8a0e-8e64a37851db admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Sep 11 15:05:28.875118 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:29.640175 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-f0184d02-282b-460d-a6ca-8888980e329e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:29.680636 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-f0184d02-282b-460d-a6ca-8888980e329e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.798177 Sep 11 15:05:29.681592 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:05:29.694771 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-f1eca8ef-2a59-45ee-8037-b02d81119d39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:29.735716 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-f1eca8ef-2a59-45ee-8037-b02d81119d39 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045028 Sep 11 15:05:29.741237 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 15:05:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:05:32.414631 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-f0184d02-282b-460d-a6ca-8888980e329e admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:32.415667 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-f0184d02-282b-460d-a6ca-8888980e329e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 11 15:05:32.416085 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:32.885404 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-3985188b-7646-451f-8a4c-e047e12d61c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:32.906035 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-3985188b-7646-451f-8a4c-e047e12d61c8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481712 Sep 11 15:05:32.906778 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:05:32.918930 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-ce53b3f7-6dd4-4978-84c6-690f2c095d95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:32.949351 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-ce53b3f7-6dd4-4978-84c6-690f2c095d95 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033930 Sep 11 15:05:32.949948 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 15:05:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:05:35.605889 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-3985188b-7646-451f-8a4c-e047e12d61c8 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:35.608609 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-3985188b-7646-451f-8a4c-e047e12d61c8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003066 Sep 11 15:05:35.609303 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:36.094398 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-e05e4369-9a2e-4a25-9920-755bf3a19d20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:36.119656 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-e05e4369-9a2e-4a25-9920-755bf3a19d20 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502284 Sep 11 15:05:36.120470 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:05:36.134342 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-e26322d5-f532-457d-a429-7d87d2ef5d4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:36.165985 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-e26322d5-f532-457d-a429-7d87d2ef5d4b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036082 Sep 11 15:05:36.166657 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 15:05:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:05:38.992654 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-e05e4369-9a2e-4a25-9920-755bf3a19d20 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:38.993772 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-e05e4369-9a2e-4a25-9920-755bf3a19d20 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Sep 11 15:05:38.994192 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:39.490521 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-20f35a6f-93f2-4b53-9aad-78bf224afae5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "id": "d4"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:39.518099 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-20f35a6f-93f2-4b53-9aad-78bf224afae5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516556 Sep 11 15:05:39.518680 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:05:39.531762 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-5a8f6148-d27e-468b-a577-6a348ae6e7d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:39.570403 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-5a8f6148-d27e-468b-a577-6a348ae6e7d2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042579 Sep 11 15:05:39.571113 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 15:05:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:05:42.363460 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-20f35a6f-93f2-4b53-9aad-78bf224afae5 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:42.366432 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-20f35a6f-93f2-4b53-9aad-78bf224afae5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004571 Sep 11 15:05:42.367109 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:42.899995 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-e7e195a3-002c-4b01-aaf4-6d6427e56d24 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:42.936409 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-e7e195a3-002c-4b01-aaf4-6d6427e56d24 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.558245 Sep 11 15:05:42.937365 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1292 bytes} [Sun Sep 11 15:05:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:05:45.591231 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-20f35a6f-93f2-4b53-9aad-78bf224afae5 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:45.592238 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-20f35a6f-93f2-4b53-9aad-78bf224afae5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 11 15:05:45.592626 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:46.045855 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-54812d9e-7481-40c4-a22f-86f095696545 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:46.067134 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-54812d9e-7481-40c4-a22f-86f095696545 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467426 Sep 11 15:05:46.067689 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 15:05:46.080107 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-7b2a81dd-b265-4f77-adf2-5146d7674a31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:46.110505 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-7b2a81dd-b265-4f77-adf2-5146d7674a31 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034049 Sep 11 15:05:46.111170 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 15:05:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:05:48.788367 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-54812d9e-7481-40c4-a22f-86f095696545 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:48.789431 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-54812d9e-7481-40c4-a22f-86f095696545 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 11 15:05:48.789835 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:49.319311 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-4e9b6147-dab2-4158-9360-77a3da2e7986 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:49.342765 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-4e9b6147-dab2-4158-9360-77a3da2e7986 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.546332 Sep 11 15:05:49.343329 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:05:49.357194 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-304bf271-bdfd-4dbf-8df8-ca2e4c613adf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:49.386410 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-304bf271-bdfd-4dbf-8df8-ca2e4c613adf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033945 Sep 11 15:05:49.387230 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 15:05:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:05:52.055300 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-4e9b6147-dab2-4158-9360-77a3da2e7986 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:52.057008 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-4e9b6147-dab2-4158-9360-77a3da2e7986 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Sep 11 15:05:52.057471 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:05:52.530135 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-fcf3d409-b563-4363-a64f-69d14a397d51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "id": "3", "disk": 40, "swap": 0}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:52.555212 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-fcf3d409-b563-4363-a64f-69d14a397d51 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.491181 Sep 11 15:05:52.556250 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:05:52.569265 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-cf5fff9e-c8ca-4fc4-bf26-e60bf2ee4851 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:52.577585 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:52.609334 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-cf5fff9e-c8ca-4fc4-bf26-e60bf2ee4851 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043946 Sep 11 15:05:52.621163 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 15:05:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:05:55.332143 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-fcf3d409-b563-4363-a64f-69d14a397d51 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:55.333167 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-fcf3d409-b563-4363-a64f-69d14a397d51 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Sep 11 15:05:55.339411 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:55.793487 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-5c85abe4-9a07-49fc-a54b-ec31dc33155c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:55.819095 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-5c85abe4-9a07-49fc-a54b-ec31dc33155c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478249 Sep 11 15:05:55.819992 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 15:05:55.832469 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-a57d7e91-93f6-469d-9dd3-5b66349b4ceb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:55.838604 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:55.862272 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-a57d7e91-93f6-469d-9dd3-5b66349b4ceb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033466 Sep 11 15:05:55.877591 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 15:05:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:05:58.600498 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-5c85abe4-9a07-49fc-a54b-ec31dc33155c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:05:58.601630 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-5c85abe4-9a07-49fc-a54b-ec31dc33155c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 11 15:05:58.602319 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:05:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:05:59.059626 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-fdc59cd8-0400-44d9-bf1d-16bd36aedf4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:59.086265 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-fdc59cd8-0400-44d9-bf1d-16bd36aedf4f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477760 Sep 11 15:05:59.093182 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 15:05:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:05:59.099608 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-3e304b21-73c8-4b82-b910-4335dac24bf9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:05:59.134471 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-3e304b21-73c8-4b82-b910-4335dac24bf9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038615 Sep 11 15:05:59.135444 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 15:05:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:06:14.552784 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-fdc59cd8-0400-44d9-bf1d-16bd36aedf4f admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:14.554046 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-fdc59cd8-0400-44d9-bf1d-16bd36aedf4f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 11 15:06:14.554046 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:06:14.564536 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:06:15.003652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-01c26eee-8e9e-4872-b99c-2d1720a354a5 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:15.027388 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-01c26eee-8e9e-4872-b99c-2d1720a354a5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.467355 Sep 11 15:06:15.027939 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1292 bytes} [Sun Sep 11 15:06:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:06:16.427724 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-fdc59cd8-0400-44d9-bf1d-16bd36aedf4f admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:16.429422 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-fdc59cd8-0400-44d9-bf1d-16bd36aedf4f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002434 Sep 11 15:06:16.430076 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:06:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:06:16.991761 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-f3349068-8f72-4f9e-a979-f540549a6e08 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:16.997189 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.wsgi [None req-f3349068-8f72-4f9e-a979-f540549a6e08 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-f3349068-8f72-4f9e-a979-f540549a6e08 admin admin] Request method failure captured: Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Accept: application/json Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Accept-Encoding: gzip, deflate Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Connection: keep-alive Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Content-Length: 0 Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Host: 10.222.0.44 Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Openstack-Api-Version: compute 2.92 Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Openstack-System-Scope: None Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: User-Agent: python-novaclient Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Auth-Token: gAAAAABjHflobOR0lgruWb9sYLxiAAeuPj1OjleUIei_IRKh-rocgCEQqqAnMOYW-LFAyYRess_34kKd5ZhUH2Mfw7gGGLJ2pDH8AIbOsHIIroxCYncOPnw1vEd4cmw-6Mf8iw9paF3juhB7B8SrP1yv-vGBp8ykfcXBJB7HbaIaWdNhcr82Kqo Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Domain-Id: None Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Domain-Name: None Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Identity-Status: Confirmed Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Is-Admin-Project: True Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Domain-Id: default Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Domain-Name: Default Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Name: admin Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Role: reader,admin,member Sep 11 15:06:17.000652 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Roles: reader,admin,member Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Tenant: admin Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Tenant-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Tenant-Name: admin Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User: admin Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Domain-Id: default Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Domain-Name: Default Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Id: e6c6442222c54f34a84fdb4577045a9f Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Name: admin Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: method: > Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: exception: Flavor 42 could not be found. Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: action_args: {'id': '42'} Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:06:17.002338 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:17.003373 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.004717 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-f3349068-8f72-4f9e-a979-f540549a6e08 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:06:17.006047 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-f3349068-8f72-4f9e-a979-f540549a6e08 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.435415 Sep 11 15:06:17.006047 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Sun Sep 11 15:06:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 15:06:17.012180 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-13e0ec7f-de87-4e5a-ab01-9fc400dfa9ba admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:17.016346 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:06:17.035964 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-13e0ec7f-de87-4e5a-ab01-9fc400dfa9ba admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027293 Sep 11 15:06:17.036538 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 15:06:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:06:17.048094 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-7bf5e7d9-6289-41a6-802a-cc6666d66237 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:17.070637 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-7bf5e7d9-6289-41a6-802a-cc6666d66237 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027498 Sep 11 15:06:17.071179 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 15:06:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:06:17.081749 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-0f895fc8-55e7-4993-b127-47fe487569b2 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:17.088017 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.wsgi [None req-0f895fc8-55e7-4993-b127-47fe487569b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-0f895fc8-55e7-4993-b127-47fe487569b2 admin admin] Request method failure captured: Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Accept: application/json Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Accept-Encoding: gzip, deflate Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Connection: keep-alive Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Content-Length: 0 Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Host: 10.222.0.44 Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Openstack-Api-Version: compute 2.92 Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Openstack-System-Scope: None Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: User-Agent: python-novaclient Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Auth-Token: gAAAAABjHflobOR0lgruWb9sYLxiAAeuPj1OjleUIei_IRKh-rocgCEQqqAnMOYW-LFAyYRess_34kKd5ZhUH2Mfw7gGGLJ2pDH8AIbOsHIIroxCYncOPnw1vEd4cmw-6Mf8iw9paF3juhB7B8SrP1yv-vGBp8ykfcXBJB7HbaIaWdNhcr82Kqo Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Domain-Id: None Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Domain-Name: None Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Identity-Status: Confirmed Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Is-Admin-Project: True Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Domain-Id: default Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Domain-Name: Default Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Name: admin Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Role: reader,admin,member Sep 11 15:06:17.091459 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Roles: reader,admin,member Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Tenant: admin Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Tenant-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Tenant-Name: admin Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User: admin Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Domain-Id: default Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Domain-Name: Default Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Id: e6c6442222c54f34a84fdb4577045a9f Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Name: admin Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: method: > Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: exception: Flavor 42 could not be found. Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: action_args: {'id': '42'} Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:06:17.092921 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:17.094039 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:17.095557 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-0f895fc8-55e7-4993-b127-47fe487569b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:06:17.096763 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-0f895fc8-55e7-4993-b127-47fe487569b2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015373 Sep 11 15:06:17.096763 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Sun Sep 11 15:06:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 15:06:18.371891 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-7bf5e7d9-6289-41a6-802a-cc6666d66237 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:18.372977 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-7bf5e7d9-6289-41a6-802a-cc6666d66237 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 Sep 11 15:06:18.373479 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:06:18.987862 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-371f324e-f5b4-4b46-9aa5-627ca6d7a2d4 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:18.993087 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.wsgi [None req-371f324e-f5b4-4b46-9aa5-627ca6d7a2d4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-371f324e-f5b4-4b46-9aa5-627ca6d7a2d4 admin admin] Request method failure captured: Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Accept: application/json Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Accept-Encoding: gzip, deflate Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Connection: keep-alive Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Content-Length: 0 Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Host: 10.222.0.44 Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Openstack-Api-Version: compute 2.92 Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Openstack-System-Scope: None Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: User-Agent: python-novaclient Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Auth-Token: gAAAAABjHflq5XW5A633tfcgphRqpmQI8lZTWjwY5fzTdoAtET1ICIDsFlUlDtYroryAHR2i5g04359UpyiWspKxJwJuRKCQGrRLxhCksxsqrUJcyAdQ1urlZ2vYuVUrY1FewXPjV4I2TBA7CQtpcpUwh8wvcbXz-kOogBNQG7DfcGcoFfYw7tY Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Domain-Id: None Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Domain-Name: None Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Identity-Status: Confirmed Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Is-Admin-Project: True Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Domain-Id: default Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Domain-Name: Default Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Name: admin Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Role: reader,admin,member Sep 11 15:06:18.994663 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Roles: reader,admin,member Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Tenant: admin Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Tenant-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Tenant-Name: admin Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User: admin Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Domain-Id: default Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Domain-Name: Default Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Id: e6c6442222c54f34a84fdb4577045a9f Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Name: admin Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: method: > Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: exception: Flavor 84 could not be found. Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: action_args: {'id': '84'} Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:06:18.997529 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:18.998494 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:18.999798 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-371f324e-f5b4-4b46-9aa5-627ca6d7a2d4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:06:19.000886 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-371f324e-f5b4-4b46-9aa5-627ca6d7a2d4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.484063 Sep 11 15:06:19.000886 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Sun Sep 11 15:06:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 15:06:19.007214 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-51e39565-b979-4854-b0c2-f0b7e266c09c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:19.023603 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-51e39565-b979-4854-b0c2-f0b7e266c09c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019900 Sep 11 15:06:19.024902 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 15:06:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:06:19.038978 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-708257bd-e9f7-40f5-9ccd-674105a6a618 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:19.067549 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-708257bd-e9f7-40f5-9ccd-674105a6a618 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.035341 Sep 11 15:06:19.068409 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 15:06:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:06:19.081031 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c971e04c-7e9a-4c9c-b092-a7e53a3e3287 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:19.086950 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.wsgi [None req-c971e04c-7e9a-4c9c-b092-a7e53a3e3287 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c971e04c-7e9a-4c9c-b092-a7e53a3e3287 admin admin] Request method failure captured: Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Accept: application/json Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Accept-Encoding: gzip, deflate Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Connection: keep-alive Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Content-Length: 0 Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Host: 10.222.0.44 Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Openstack-Api-Version: compute 2.92 Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Openstack-System-Scope: None Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: User-Agent: python-novaclient Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Auth-Token: gAAAAABjHflq5XW5A633tfcgphRqpmQI8lZTWjwY5fzTdoAtET1ICIDsFlUlDtYroryAHR2i5g04359UpyiWspKxJwJuRKCQGrRLxhCksxsqrUJcyAdQ1urlZ2vYuVUrY1FewXPjV4I2TBA7CQtpcpUwh8wvcbXz-kOogBNQG7DfcGcoFfYw7tY Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Domain-Id: None Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Domain-Name: None Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Identity-Status: Confirmed Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Is-Admin-Project: True Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Domain-Id: default Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Domain-Name: Default Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Name: admin Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Role: reader,admin,member Sep 11 15:06:19.088510 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Roles: reader,admin,member Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Tenant: admin Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Tenant-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Tenant-Name: admin Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User: admin Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Domain-Id: default Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Domain-Name: Default Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Id: e6c6442222c54f34a84fdb4577045a9f Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Name: admin Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: method: > Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: exception: Flavor 84 could not be found. Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: action_args: {'id': '84'} Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:06:19.091010 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:19.092798 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:19.095270 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c971e04c-7e9a-4c9c-b092-a7e53a3e3287 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:06:19.097404 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c971e04c-7e9a-4c9c-b092-a7e53a3e3287 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013525 Sep 11 15:06:19.097404 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Sun Sep 11 15:06:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 11 15:06:20.420997 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-708257bd-e9f7-40f5-9ccd-674105a6a618 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:20.422196 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-708257bd-e9f7-40f5-9ccd-674105a6a618 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Sep 11 15:06:20.422631 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:06:21.065874 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-97d6d690-b0d6-4574-8a18-eea2e19b8b8f admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:21.072613 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.wsgi [None req-97d6d690-b0d6-4574-8a18-eea2e19b8b8f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-97d6d690-b0d6-4574-8a18-eea2e19b8b8f admin admin] Request method failure captured: Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Accept: application/json Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Accept-Encoding: gzip, deflate Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Connection: keep-alive Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Content-Length: 0 Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Host: 10.222.0.44 Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Openstack-Api-Version: compute 2.92 Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Openstack-System-Scope: None Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: User-Agent: python-novaclient Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Auth-Token: gAAAAABjHflsvYKiKdhHze6XaAr1nyiI4H191s2ubZ2kwo4ogsH4baFywPKhtxjPgdUIzI85OL9iWvv2DYUqBEDbeMx0sRqo4jOMupMo7t5iWsUIzs3sZGMzJJB66ATxRePVXoO5tA_tjgYgMRnfDKKzmlGbhBp4D6WpGtIv0FlOOnJTlZNF164 Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Domain-Id: None Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Domain-Name: None Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Identity-Status: Confirmed Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Is-Admin-Project: True Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Domain-Id: default Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Domain-Name: Default Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Project-Name: admin Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Role: reader,admin,member Sep 11 15:06:21.074213 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Roles: reader,admin,member Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Tenant: admin Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Tenant-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-Tenant-Name: admin Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User: admin Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Domain-Id: default Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Domain-Name: Default Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Id: e6c6442222c54f34a84fdb4577045a9f Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: X-User-Name: admin Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: method: > Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: exception: Flavor 451 could not be found. Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: action_args: {'id': '451'} Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:06:21.077473 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:21.078629 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.079899 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-97d6d690-b0d6-4574-8a18-eea2e19b8b8f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:06:21.081178 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-97d6d690-b0d6-4574-8a18-eea2e19b8b8f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.509894 Sep 11 15:06:21.081178 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 15:06:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 11 15:06:21.088268 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-95b507dc-c8a9-48d1-b5e4-6837d1d7b467 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:21.104049 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-95b507dc-c8a9-48d1-b5e4-6837d1d7b467 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019726 Sep 11 15:06:21.104637 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 15:06:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:06:21.118820 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:21.135215 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023348 Sep 11 15:06:21.135793 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 15:06:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:06:21.146323 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-1315352b-a720-4bd0-b92d-19e7e6f01260 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:21.151822 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.wsgi [None req-1315352b-a720-4bd0-b92d-19e7e6f01260 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-1315352b-a720-4bd0-b92d-19e7e6f01260 admin admin] Request method failure captured: Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Accept: application/json Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Accept-Encoding: gzip, deflate Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Connection: keep-alive Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Content-Length: 0 Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Host: 10.222.0.44 Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Openstack-Api-Version: compute 2.92 Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Openstack-System-Scope: None Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: User-Agent: python-novaclient Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Auth-Token: gAAAAABjHflsvYKiKdhHze6XaAr1nyiI4H191s2ubZ2kwo4ogsH4baFywPKhtxjPgdUIzI85OL9iWvv2DYUqBEDbeMx0sRqo4jOMupMo7t5iWsUIzs3sZGMzJJB66ATxRePVXoO5tA_tjgYgMRnfDKKzmlGbhBp4D6WpGtIv0FlOOnJTlZNF164 Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Domain-Id: None Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Domain-Name: None Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Identity-Status: Confirmed Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Is-Admin-Project: True Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Domain-Id: default Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Domain-Name: Default Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Project-Name: admin Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Role: reader,admin,member Sep 11 15:06:21.153460 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Roles: reader,admin,member Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/866dbf4792e0480eb3f18a3e97bbaa75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Tenant: admin Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Tenant-Id: 866dbf4792e0480eb3f18a3e97bbaa75 Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-Tenant-Name: admin Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User: admin Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Domain-Id: default Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Domain-Name: Default Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Id: e6c6442222c54f34a84fdb4577045a9f Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: X-User-Name: admin Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: method: > Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: exception: Flavor 451 could not be found. Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: action_args: {'id': '451'} Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:06:21.156282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:21.157898 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 11 15:06:21.159985 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-1315352b-a720-4bd0-b92d-19e7e6f01260 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:06:21.161951 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-1315352b-a720-4bd0-b92d-19e7e6f01260 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012629 Sep 11 15:06:21.161951 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 15:06:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 15:06:22.434789 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:22.436094 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 Sep 11 15:06:22.436636 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:06:23.034368 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-1471ad3a-9f0a-4661-baf8-2f6482d61859 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:06:23.060298 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-1471ad3a-9f0a-4661-baf8-2f6482d61859 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.485707 Sep 11 15:06:23.060842 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Sun Sep 11 15:06:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 15:06:24.328819 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:24.329946 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Sep 11 15:06:24.330320 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:06:24.888720 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-9a90da63-dbd9-4b51-a322-53664fbfaa71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:06:24.908427 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-9a90da63-dbd9-4b51-a322-53664fbfaa71 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.439922 Sep 11 15:06:24.908961 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Sun Sep 11 15:06:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:06:26.206838 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:26.207862 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 11 15:06:26.208260 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:06:26.769528 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-3a962312-f491-4cf7-8797-bd57682a45d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:06:26.790812 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-3a962312-f491-4cf7-8797-bd57682a45d7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.446257 Sep 11 15:06:26.791374 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Sun Sep 11 15:06:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:06:28.052178 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:28.053203 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001839 Sep 11 15:06:28.053600 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:06:28.603430 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-8c9708cd-71c5-4544-8093-31a6fcf0a4e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:06:28.622927 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-8c9708cd-71c5-4544-8093-31a6fcf0a4e1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.433650 Sep 11 15:06:28.623479 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Sun Sep 11 15:06:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:06:29.879628 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:29.880750 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Sep 11 15:06:29.881229 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:06:30.486410 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-c38c74c9-f45d-41c1-b759-1cbb6a4653d8 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:06:30.512399 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-c38c74c9-f45d-41c1-b759-1cbb6a4653d8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.494999 Sep 11 15:06:30.512962 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Sun Sep 11 15:06:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:07:29.326047 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:07:29.327131 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c1bd78ca-7c30-415b-8635-bdaf970c5d2a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Sep 11 15:07:29.327496 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 15:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:07:29.339664 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:29.751856 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-0420c015-07f2-4606-8e07-c872423526a6 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:07:29.772638 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-0420c015-07f2-4606-8e07-c872423526a6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.437782 Sep 11 15:07:29.773208 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1292 bytes} [Sun Sep 11 15:07:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:07:29.794121 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=14 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:29.797921 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-eb2c5e3a-6735-49dd-977e-41f079618453 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:07:29.805562 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-eb2c5e3a-6735-49dd-977e-41f079618453 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012855 Sep 11 15:07:29.806093 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1283 bytes} [Sun Sep 11 15:07:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:07:29.818259 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-f730a2f5-17e8-4d56-b2bb-3e362b1bafa1 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:07:29.825858 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-f730a2f5-17e8-4d56-b2bb-3e362b1bafa1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011220 Sep 11 15:07:29.828745 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1286 bytes} [Sun Sep 11 15:07:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:07:29.841636 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:07:29.849167 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011284 Sep 11 15:07:29.849702 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1286 bytes} [Sun Sep 11 15:07:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:07:29.861610 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-93252919-3990-4b27-a6be-0ba4cbf273d6 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:07:29.869441 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-93252919-3990-4b27-a6be-0ba4cbf273d6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011418 Sep 11 15:07:29.869963 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1283 bytes} [Sun Sep 11 15:07:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:10:25.905185 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:10:25.906188 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 11 15:10:25.906582 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:10:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:10:26.045971 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=6 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:26.226140 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-ec3597e8-3702-431c-8e5a-505b1bcff6e3 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:10:26.231165 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ec3597e8-3702-431c-8e5a-505b1bcff6e3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:10:26.231640 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ec3597e8-3702-431c-8e5a-505b1bcff6e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:10:26.232246 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ec3597e8-3702-431c-8e5a-505b1bcff6e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:10:26.232962 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ec3597e8-3702-431c-8e5a-505b1bcff6e3 admin admin] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:10:26.233437 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ec3597e8-3702-431c-8e5a-505b1bcff6e3 admin admin] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:10:26.233852 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ec3597e8-3702-431c-8e5a-505b1bcff6e3 admin admin] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:10:26.265583 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-ec3597e8-3702-431c-8e5a-505b1bcff6e3 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.220797 Sep 11 15:10:26.266160 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 15:10:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:10:27.376957 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:10:27.378402 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Sep 11 15:10:27.378997 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:10:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:10:27.590015 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-f11634bf-2790-4c06-a64d-10bd5d72e7e8 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:10:27.593537 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-f11634bf-2790-4c06-a64d-10bd5d72e7e8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:10:27.594013 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-f11634bf-2790-4c06-a64d-10bd5d72e7e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:10:27.594465 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-f11634bf-2790-4c06-a64d-10bd5d72e7e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:10:27.595150 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-f11634bf-2790-4c06-a64d-10bd5d72e7e8 admin admin] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:10:27.595587 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-f11634bf-2790-4c06-a64d-10bd5d72e7e8 admin admin] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:10:27.595998 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-f11634bf-2790-4c06-a64d-10bd5d72e7e8 admin admin] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:10:27.622583 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-f11634bf-2790-4c06-a64d-10bd5d72e7e8 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.093257 Sep 11 15:10:27.623147 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 15:10:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:10:39.125289 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:10:39.126295 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 11 15:10:39.126680 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:10:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:10:39.270766 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell0:SELECT=4 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:39.271533 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell1:SELECT=4 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:39.272297 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=8 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:39.325267 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-69981796-4c42-42d3-bf61-766c5df14c70 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:10:39.329643 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-69981796-4c42-42d3-bf61-766c5df14c70 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:10:39.330282 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-69981796-4c42-42d3-bf61-766c5df14c70 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:10:39.330713 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-69981796-4c42-42d3-bf61-766c5df14c70 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:10:39.331443 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-69981796-4c42-42d3-bf61-766c5df14c70 admin admin] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:10:39.331886 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-69981796-4c42-42d3-bf61-766c5df14c70 admin admin] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:10:39.332294 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-69981796-4c42-42d3-bf61-766c5df14c70 admin admin] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:10:39.358457 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-69981796-4c42-42d3-bf61-766c5df14c70 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.092364 Sep 11 15:10:39.359017 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 15:10:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:10:40.428140 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:10:40.429172 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-34c3bf6c-b92f-43f4-9a2f-e646c7b72b93 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 11 15:10:40.429581 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 15:10:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:10:40.630896 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-78e7db0c-11e6-4a80-ad79-c49c957171c7 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:10:40.634316 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-78e7db0c-11e6-4a80-ad79-c49c957171c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:10:40.634790 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-78e7db0c-11e6-4a80-ad79-c49c957171c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:10:40.635210 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-78e7db0c-11e6-4a80-ad79-c49c957171c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:10:40.635912 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-78e7db0c-11e6-4a80-ad79-c49c957171c7 admin admin] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:10:40.636349 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-78e7db0c-11e6-4a80-ad79-c49c957171c7 admin admin] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:10:40.636729 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-78e7db0c-11e6-4a80-ad79-c49c957171c7 admin admin] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:10:40.658204 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-78e7db0c-11e6-4a80-ad79-c49c957171c7 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087045 Sep 11 15:10:40.658738 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 15:10:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:11:36.620764 dv-cinder-839768-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 11 15:11:36.621421 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: Sun Sep 11 15:11:36 2022 - graceful shutdown triggered... Sep 11 15:11:36.621861 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: Gracefully killing worker 2 (pid: 105708)... Sep 11 15:11:36.622345 dv-cinder-839768-7-iscsi devstack@n-api.service[105707]: Gracefully killing worker 1 (pid: 105707)... Sep 11 15:11:36.754552 dv-cinder-839768-7-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=4 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:11:37.622799 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: worker 1 buried after 1 seconds Sep 11 15:11:37.622799 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: worker 2 buried after 1 seconds Sep 11 15:11:37.622799 dv-cinder-839768-7-iscsi devstack@n-api.service[105706]: goodbye to uWSGI. Sep 11 15:11:37.625061 dv-cinder-839768-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 11 15:11:37.625858 dv-cinder-839768-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 11 15:11:37.629643 dv-cinder-839768-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 15:11:37.641672 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 15:11:37 2022] *** Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: nodename: dv-cinder-839768-7-iscsi Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: machine: x86_64 Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: clock source: unix Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: pcre jit disabled Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: detected number of CPU cores: 4 Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: current working directory: / Sep 11 15:11:37.643634 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: detected binary path: /usr/bin/uwsgi-core Sep 11 15:11:37.644285 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: your processes number limit is 47680 Sep 11 15:11:37.644285 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: your memory page size is 4096 bytes Sep 11 15:11:37.644285 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: detected max file descriptor number: 2048 Sep 11 15:11:37.644285 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: lock engine: pthread robust mutexes Sep 11 15:11:37.644285 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: thunder lock: enabled Sep 11 15:11:37.644285 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 15:11:37.644285 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 15:11:37.686896 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: Python main interpreter initialized at 0x56244f15f9c0 Sep 11 15:11:37.686896 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: python threads support enabled Sep 11 15:11:37.686896 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: your server socket listen backlog is limited to 100 connections Sep 11 15:11:37.686896 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: your mercy for graceful operations on workers is 90 seconds Sep 11 15:11:37.687351 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 15:11:37.687351 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: *** Operational MODE: preforking *** Sep 11 15:11:37.687625 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: *** uWSGI is running in multiple interpreter mode *** Sep 11 15:11:37.687625 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: spawned uWSGI master process (pid: 120727) Sep 11 15:11:37.687858 dv-cinder-839768-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 11 15:11:37.690854 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: spawned uWSGI worker 1 (pid: 120739, cores: 1) Sep 11 15:11:37.690854 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: spawned uWSGI worker 2 (pid: 120740, cores: 1) Sep 11 15:11:37.690854 dv-cinder-839768-7-iscsi devstack@n-api.service[120727]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 15:11:38.363867 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 15:11:38.364676 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 15:11:39.508384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 15:11:39.508384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: from cryptography.utils import int_from_bytes Sep 11 15:11:39.509097 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 15:11:39.509097 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: from cryptography.utils import int_from_bytes Sep 11 15:11:39.510930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 15:11:39.510930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: from cryptography.utils import int_from_bytes Sep 11 15:11:39.511410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 15:11:39.511410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: from cryptography.utils import int_from_bytes Sep 11 15:11:41.898929 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 15:11:41.899521 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 15:11:41.899620 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 15:11:41.900020 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 15:11:41.900256 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 15:11:41.900648 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.900974 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.901320 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.901656 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.901988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.902280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.902614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.902830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 15:11:41.903205 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.903307 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 15:11:41.903386 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.903463 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.903664 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 15:11:41.903767 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.904053 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 15:11:41.904235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-7-iscsi {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.904343 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 15:11:41.904564 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.904669 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.904872 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.904985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.905210 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.905323 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.905528 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.905636 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.905831 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.905944 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.906151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.906259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.906457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.906557 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.906807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.906975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.907167 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.907394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.907713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.908240 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-7-iscsi {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.908562 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.908814 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.909039 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.909296 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.909537 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.909758 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.909974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.910212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.910416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.910632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.910843 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.911061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.911277 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.911493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.911493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.911906 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.912146 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.912351 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.912578 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.912796 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.912796 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.913315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-7-iscsi {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.913562 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.913740 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.913958 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.914114 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.914288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.915328 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.915471 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.915551 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.915632 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.915713 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.915795 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.915877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.915953 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916029 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-7-iscsi {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916258 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916413 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916484 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916554 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916554 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916696 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916844 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916913 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.916990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917069 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917181 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917271 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917349 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917513 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917597 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917693 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917783 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917875 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.917959 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.921171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.921345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.921444 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.921534 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.921627 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.921713 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.921811 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.921896 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.921984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922168 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922261 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922359 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922444 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922621 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922705 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922800 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922891 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.922986 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923077 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923167 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923258 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923258 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923258 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923258 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923258 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923258 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923721 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923721 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923721 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.923971 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.924199 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.924336 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.924514 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.924669 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.924828 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.924984 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.925170 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.925321 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.925482 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.925632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.925833 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.925986 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.926145 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.926299 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.926461 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.926602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.926749 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.926932 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.927088 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.927244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.927386 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.927526 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.927667 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.927924 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.928269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.928269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.928817 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.928967 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.929128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.929373 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.929528 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.929690 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.929844 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.930001 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.930144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.930284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.930435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.930435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.930739 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.930881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.931022 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.931022 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.931308 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.931459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.931601 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.931601 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.931877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.932026 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.932185 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.932327 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.932478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.932627 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.932777 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.932925 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.933079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.933270 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.933421 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.933564 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.933706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.933854 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.934010 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.934172 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.934323 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.934480 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.934633 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.934774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.934925 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.935066 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.935213 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.935362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.935502 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.935652 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.935801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.936004 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.936155 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.936303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.936455 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.936606 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.936748 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.936888 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.937081 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.937081 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.937444 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.937601 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.937750 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.937892 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.938033 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.938405 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.938791 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.938970 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.939114 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.939256 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.939411 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.939553 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.939705 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.939857 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.940005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.940155 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.940303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.940452 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.940602 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.940835 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.940991 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.941159 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.941307 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.941460 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.941616 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.941765 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.941907 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.942054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.942203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.942353 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.942504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.942653 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.942794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.942952 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.943103 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.943251 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.943403 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.943552 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.943693 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.943833 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.943981 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.944123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.944277 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.944418 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.944566 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.944735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.944879 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.945034 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.945219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.945377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.945527 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.945668 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.945809 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.945963 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.946105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.946254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.946395 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.946543 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.946781 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.946937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.947125 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.947280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.947430 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.947578 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.947719 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.947874 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.948016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.948165 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.948370 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.948620 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.949011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.949218 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 15:11:41.949368 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.949510 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.949709 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.949867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.950023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.950167 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.950316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.950459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.950599 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.950739 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.950889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.951048 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.951189 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.951339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.951489 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.951646 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.952151 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.952303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.952445 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.952592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.952732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.952881 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.953022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.953194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.953362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.953516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.953670 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.953811 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.953965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.954115 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.954262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.954410 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.954559 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.954718 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.954875 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.955025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.955187 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.955335 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.955486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.955628 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.955778 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.955919 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.956066 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.956208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.956348 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.956497 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.956649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.956790 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.956938 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.957097 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.957337 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.957493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.957644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.957786 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.957926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.958075 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.958224 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.958381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.958521 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.958754 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.959128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.959288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.959451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.959608 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.959759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.959900 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.960040 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.960180 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.960329 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.960484 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.960626 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.960775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.960918 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.961059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.961236 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.961391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.961531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.961701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.961846 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.961994 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.962146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.962295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.962449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.962590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.962737 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.962885 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.963041 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.963193 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.963334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.963475 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.963623 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.963775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.963931 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.964074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.964226 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.964374 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.964521 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.964681 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.964824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.964974 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.965171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.965321 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.965471 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.965623 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.965765 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.965906 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.966054 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.966196 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.966344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.966499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.966499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.966767 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.966916 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.967071 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.969984 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.970858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.971023 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.971183 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.971332 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.971477 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.971621 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.972023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.972176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.972341 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.972507 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.972650 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.972798 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.972941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.973083 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.973278 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.973431 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.973573 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.973713 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.973853 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.973994 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.974149 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.974291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.974453 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.974604 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.974753 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.974923 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.975163 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.975319 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.975461 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.975615 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.975771 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.975922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.976064 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.976205 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.976355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.976508 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.976658 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.976815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.976965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.977119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.977334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.977483 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.977640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.977782 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.978067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.978218 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.978404 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.978566 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.978724 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.978866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.979006 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.979156 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.979297 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.979439 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.979589 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.980124 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.980286 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.980478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.980635 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.980788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.980952 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.981095 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.981276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.981431 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.981574 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.981730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.981931 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.982074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.982215 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.982364 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.982505 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.982696 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.982853 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.983007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.983148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.983290 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.983430 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.983587 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.983736 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.983886 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.984029 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.984170 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.984316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.984477 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.984622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.984771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.984932 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.985074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.985303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.985447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.985595 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.986180 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.986334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.986472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.986622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.986759 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.986901 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.986991 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.987082 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.987179 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.987276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.987414 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.987555 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.987682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.987785 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.987876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.987970 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988063 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988147 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988276 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988409 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988541 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988736 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988826 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988911 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.988993 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989093 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989235 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989323 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989406 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989497 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989583 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989675 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989777 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.989926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.990324 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.990418 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.990517 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.990602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.990686 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.990775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.990867 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.990958 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991147 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991284 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991376 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991468 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991566 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991651 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991734 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991899 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.991981 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992078 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992163 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992247 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992337 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992617 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992704 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.992977 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993061 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993199 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993386 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993681 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993780 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993865 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.993947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994037 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994127 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994224 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994309 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994407 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994590 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994674 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994766 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994850 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.994932 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995111 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995359 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995454 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995621 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995704 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995793 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995891 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.995983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996068 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996150 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996239 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996580 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996670 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996754 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996850 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.996942 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997027 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997115 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997320 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997652 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997740 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997875 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.997971 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998106 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998198 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998290 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998374 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998510 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998647 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998826 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998909 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.998992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.999074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.999165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.999251 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.999340 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.999424 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.999612 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.999727 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:41.999925 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.000045 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.000328 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.000469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.000567 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.000692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.001090 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.001768 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.001910 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002038 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002422 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002512 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002597 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002680 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.002938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.003020 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.003109 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.003316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.003417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.003620 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.003718 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.003948 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.004038 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.004263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.004374 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.004571 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.004669 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.004886 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.005046 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.005217 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.005311 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.005530 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.005633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.005846 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.005946 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.006161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.006324 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.006472 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.006572 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.006776 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.006874 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.007085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.007184 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.007387 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.007478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.007692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.007791 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.008010 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.008104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.008598 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.008737 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.008929 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.009054 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.009325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.009420 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.009653 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.009744 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.009996 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.010096 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.011172 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.011368 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.011535 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.011689 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.011689 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.011992 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.012152 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.012310 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.012467 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.012623 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.012773 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.012922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.012922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.013273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.013435 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.013585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.013734 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.013891 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.013996 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.014085 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.014170 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.014261 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.014347 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.014440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.014527 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.014617 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.014617 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.014779 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.015000 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.015311 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.015482 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.015613 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.015806 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.015908 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.016129 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.016236 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.016459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.016550 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.016778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.016869 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.017096 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.017278 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.017441 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.017936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.018054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.018175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.018300 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.018410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.018527 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.018639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.018778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.018905 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.019044 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.019178 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.019305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.019490 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.019608 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.019839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.019945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.020150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.020253 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.020462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.020560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.020789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.020927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.021099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.021398 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.021639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.021746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.021859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.021954 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.022122 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.022214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.022426 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.022515 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.022727 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.022821 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.023038 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.023142 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.023346 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.023444 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.023648 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.023739 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.023959 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.024059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.024268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.024373 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.024579 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.024695 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.024914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.025003 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.025243 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.025352 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.025554 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.025645 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.025863 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.025961 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.026170 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.026270 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.026476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.026575 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.026779 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.026879 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.027083 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.027182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.027390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.027481 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.027693 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.027784 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.027995 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.028095 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.028302 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.028401 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.028602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.028693 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.028907 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.029005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.029238 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.029362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.029543 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.029633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.029848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.029943 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.030157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.030268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.030467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.030571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.030770 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.030869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.031081 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.031205 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.031381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.031480 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.031689 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.031795 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.031987 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.032086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.032294 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.032394 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.032596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.032686 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.032898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.032990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.033241 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.033354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.033555 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.033653 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.033879 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.034019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.034165 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.034266 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.034469 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.034567 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.034771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.034861 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.035073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.035177 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.035374 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.035464 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.035675 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.035773 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.035975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.036065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.036275 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.036367 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.036583 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.036674 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.036886 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.036985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.037219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.037325 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.037556 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.037655 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.037838 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.037929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.038155 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.038275 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.038445 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.038552 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.038747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.038838 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.039087 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.039186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.039393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.039535 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.039741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.039831 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.040045 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.040135 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.040550 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.040667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.040785 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.040936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.041096 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.041736 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.041736 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.041917 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.042011 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.042095 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.042187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.042360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.042448 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.042545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.042631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.042803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.042927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.043125 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.043231 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.043439 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.043539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.043750 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.043842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.044079 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.044179 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.044404 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.044549 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.044721 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.044819 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.045025 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.045125 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.045363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.045467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.045662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.045752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.045974 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.046083 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.046285 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.046385 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.046593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.046684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.046904 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.046996 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.047212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.047304 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.047523 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.047616 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.047834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.047927 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.048144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.048234 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.048454 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.048552 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.048761 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.048861 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.049069 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.049205 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.049412 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.049510 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.049720 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.049814 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.050025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.050124 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.050333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.050440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.050644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.050744 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.050948 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.051046 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.051257 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.051363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.051562 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.051815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.051911 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.051994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.052179 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.052295 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.052594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.052692 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.052897 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.052988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.053235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.053372 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.053543 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.053643 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.053859 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.053962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.054168 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.054270 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.054484 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.054586 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.054799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.054894 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.055102 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.055198 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.055504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.055605 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.055818 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.055912 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.056154 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.056248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.056464 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.056559 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.056768 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.056862 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.057073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.057185 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.057416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.057510 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.057723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.057826 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.058029 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.058131 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.058331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.058432 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.058636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.058812 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.058961 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.059062 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.059263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.059364 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.059574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.059685 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.059970 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.060065 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.060294 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.060458 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.060604 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.060710 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.060984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.061082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.061335 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.061440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.061661 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.061768 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.062010 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.062101 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.062282 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.062384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.062606 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.062706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.062902 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.062992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.063216 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.063323 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.063529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.063622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.063840 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.063930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.064164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.064257 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.064473 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.064570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.064788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.064887 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.065094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.065265 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.065442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.065547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.065771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.065861 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.066078 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.066170 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.066402 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.066492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.066802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.066902 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.067133 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.067232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.067472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.067585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.067763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.067870 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.068073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.068173 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.068447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.068552 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.068688 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.068788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.068997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.069095 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.069325 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.069417 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.069636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.069741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.069965 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.070088 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.070275 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.070380 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.070589 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.070685 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.070898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.070997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.071201 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.071299 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.071503 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.071613 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.071859 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.071991 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.072188 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.072298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.072745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.072848 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.072946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.073032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.073125 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.073268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.073429 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.073522 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.073752 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.073853 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.074059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.074154 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.074382 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.074484 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.074691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.074792 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.075030 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.075169 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.075291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.075416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.075593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.075727 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.075934 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.076041 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.076241 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.076379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.076562 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.076713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.077277 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.077427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.077608 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.077766 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.077919 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.078099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.078252 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.078424 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.078582 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.078749 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.078902 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.079065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.079208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.079376 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.079517 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.079685 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.079826 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.079994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.080128 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.080309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.080402 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.080618 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.080711 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.080926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.081103 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.081260 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.081362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.081571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.081672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.081878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.082013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.082198 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.082342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.082485 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.082584 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.082788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.082880 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.083109 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.083200 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.083413 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.083516 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.083732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.083830 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.084060 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.084202 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.084344 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.084459 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.084650 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.084863 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.084965 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.085107 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.085288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.085425 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.085594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.085712 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.085920 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.086038 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.086229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.086338 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.086553 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.086646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.086872 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.086963 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.087209 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.087312 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.087526 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.087616 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.087840 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.087930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.088152 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.088256 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.088468 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.088569 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.088776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.088870 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.089078 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.089247 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.089418 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.089520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.089732 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.089869 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.090048 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.090308 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.090621 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.090723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.090936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.091035 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.091249 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.091342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.091561 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.091652 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.091879 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.091979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.092190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.092321 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.092501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.092602 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.092814 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.092915 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.093122 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.093233 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.093455 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.093546 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.093768 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.093873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.094097 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.094201 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.094420 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.094512 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.094745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.094849 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.095072 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.095163 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.095394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.095494 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.095708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.095799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.096348 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.096504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.096601 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.096686 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.096783 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.096878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.096985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.097078 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.097647 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.097839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098261 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098347 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098523 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098618 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098704 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098788 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098879 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.098964 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.099122 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.099248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.099434 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.099535 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.099749 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.099852 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.100049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.100153 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.100362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.100496 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.100680 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.100816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.100994 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.101077 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.101351 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.101459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.101671 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.101773 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.102116 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.102253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.102343 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.102473 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.102600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.102852 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.103402 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.103595 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.103728 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.103822 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.103907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.104002 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.104188 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.104369 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.104512 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.104599 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.105055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.105519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.105706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.105803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.105889 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.105984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.106079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.106550 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.106657 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.106745 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.106838 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.106930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.107158 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.107303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.107449 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.107582 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.107713 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.107853 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.108004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.108143 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.108272 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.108401 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.108579 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.108722 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.108862 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.108991 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.109146 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.109287 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.109417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.109560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.109697 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.109883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.110115 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.110289 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.110426 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.110646 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.110812 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.110945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.111093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.111226 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.111352 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.111504 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.111639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.111769 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.111910 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.112084 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.112213 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.112399 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.112529 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.112730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.112884 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.113022 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.113179 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.113322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.113451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.113580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.113719 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.113849 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.113989 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.114118 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.114246 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.114384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.114552 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.114684 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.114884 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.115025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.115191 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.115333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.115499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.115632 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.115807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.115939 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.116107 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.116247 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.116410 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.116558 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.116715 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.116904 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.117079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.117406 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.117597 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.117748 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.117889 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.118021 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.118021 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.118262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.118400 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.118546 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.118674 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.118802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.118947 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.119109 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.119269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.119411 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.119573 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.119717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.119902 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.120060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.120203 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.120339 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.120502 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.120648 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.120835 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.120988 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.121156 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.121370 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.121516 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.121653 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.121792 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.121927 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.122069 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.122256 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.122386 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.122560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.122688 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.122882 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.123056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.123216 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.123529 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.123663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.123869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.124018 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.124195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.124336 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.124530 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.124671 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.124840 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.124984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.125155 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.125293 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.125469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.125601 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.125774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.126325 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.126325 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.126581 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.126709 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.126844 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.126975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.127117 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.127246 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.127374 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.127501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.127638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.127780 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.127907 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.128050 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.128177 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.128305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.128441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.128591 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.128718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.128853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.128980 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.129108 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.129306 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.129445 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.129585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.129723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.129860 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.129988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.130176 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.130315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.130505 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.130662 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.130799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.130926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.131082 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.131233 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.131365 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.131570 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.131755 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.131891 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.132030 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.132167 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.132344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.132492 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.132675 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.132815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.132949 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.133082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.133276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.133422 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.133562 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.133709 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.133839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.133966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.134093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.134336 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.134518 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.134732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.134866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.135060 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.135191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.135380 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.135528 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.135686 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.135824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.135995 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.136137 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.136322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.136472 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.136647 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.136791 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.136957 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.137090 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.137304 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.137453 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.137619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.137750 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.137947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.138091 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.138294 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.138438 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.138602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.138745 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.138925 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.139059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.139273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.139411 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.139538 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.139673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.139802 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.139929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.140108 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.140287 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.140426 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.140567 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.140714 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.140856 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.141024 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.141193 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.141345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.141486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.141650 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.141788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.141960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.142100 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.142262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.142397 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.142564 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.142781 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.142930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.143068 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.143212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.143355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.143492 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.143646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.143782 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.144219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.144366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.144507 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.144637 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.144785 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.144923 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.145052 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.145226 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.145366 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.145509 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.145659 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.145789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.145928 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.146067 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.146204 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.146343 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.146489 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.146619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.146756 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.146950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.147128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.147314 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.147502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.147666 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.147798 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.147933 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.148072 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.148213 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.148340 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.148538 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.148689 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.148827 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.149034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.149265 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.149409 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.149540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.149671 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.149671 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.149939 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.150067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.150194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.150320 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.150450 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.150589 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.150735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.150881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.151016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.151159 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.151290 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.151435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.151561 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.151561 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.151803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.151939 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.152064 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.152269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.152504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.152504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.152760 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.152890 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.153070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.153070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.153435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.153587 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.153715 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.153844 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.153989 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.154124 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.154252 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.154389 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.154526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.154663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.154803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.154941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.155067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.155204 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.155338 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.155492 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.155647 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.155805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.155946 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.156107 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.156248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.156415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.156558 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.156726 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.156868 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.157030 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.157185 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.157361 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.157502 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.157672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.157805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.157982 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.158121 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.158295 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.158431 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.158620 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.158801 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.158941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.159068 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.159231 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.159363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.159555 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.159684 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.159883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.160028 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.160199 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.160338 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.160536 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.160677 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.160862 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.161016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.161233 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.161362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.161491 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.161620 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.161783 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.161929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.162058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 15:11:42.162195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 15:11:42.162462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 15:11:42.223774 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Registered counter for database nova_api Sep 11 15:11:42.224163 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Registered counter for database nova_api Sep 11 15:11:42.245950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:11:42.250464 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:11:42.253874 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:11:42.258073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:11:42.311605 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.context [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e60759ca-dd72-43ee-a0ab-eedd3bf86111(cell1) {{(pid=120739) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 15:11:42.315134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.context [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e60759ca-dd72-43ee-a0ab-eedd3bf86111(cell1) {{(pid=120740) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 15:11:42.315375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:11:42.315853 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:11:42.317447 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:11:42.318212 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:11:42.318657 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:11:42.319210 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:11:42.319692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:11:42.320668 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:11:42.321312 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:11:42.322116 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:11:42.322567 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:11:42.322823 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Registered counter for database nova_cell0 Sep 11 15:11:42.324580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:11:42.327133 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Registered counter for database nova_cell0 Sep 11 15:11:42.327338 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Registered counter for database nova_cell1 Sep 11 15:11:42.331366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Registered counter for database nova_cell1 Sep 11 15:11:42.336204 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:11:42.337492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:11:42.339049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:11:42.341396 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:11:42.346462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:11:42.346612 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:11:42.348550 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:11:42.349228 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:11:42.495947 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Registered counter for database nova_cell0 Sep 11 15:11:42.496594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Registered counter for database nova_cell0 Sep 11 15:11:42.504233 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:11:42.506695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 15:11:42.509181 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:11:42.511699 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 15:11:42.823789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 15:11:42.829922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 15:11:42.831635 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 15:11:42.837401 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 15:11:43.175345 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 15:11:43.182119 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-4c97a523-b6a7-44e2-99a9-6d2760e1d10e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 15:11:43.184345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 15:11:43.188181 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56244f15f9c0 pid: 120739 (default app) Sep 11 15:11:43.190501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-5fb020ba-8a4a-4563-80b6-e04185710076 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 15:11:43.195884 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56244f15f9c0 pid: 120740 (default app) Sep 11 15:12:19.488357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:19.491437 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:19.492214 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:19.493498 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:19.770710 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:19.773308 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:19.774360 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:19.776012 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:20.593423 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ce4ee421-990e-4f0f-96cd-03b3b96a22fa tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Action: 'create', calling method: .version_select at 0x7f3938fab430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1318078798", "metadata": {"Type": "work"}}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ce4ee421-990e-4f0f-96cd-03b3b96a22fa tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Request method failure captured: Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 122 Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrTtH-pCQ1neQRsQoPcEHYi2SMOKQEhvKSWg1jm5_vhPQvf_tdMklUhhhtcrNrdHJezP9RtXJrDfLhJ4t_WZKyctzpnGHeyjq-d8X6A2rYCopIo9RkwsUHLM4Ms4upZUH5KvhTATuo0WmxK61oEt-U_WO_3G-knwN8kNhvSxfVCVFo Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:12:20.599988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_053104c5c4504dba86cd8749650f94b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 1121f5db549842a8b1b9b3bbaf0cfb42 Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1318078798", "metadata": {"Type": "work"}}} Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: Sep 11 15:12:20.602595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1318078798', 'metadata': {'Type': 'work'}}}} Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise error Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi '#$%' Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:12:20.604138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 15:12:20.608807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 15:12:20.614778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 15:12:20.614778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.614778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ce4ee421-990e-4f0f-96cd-03b3b96a22fa tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:12:20.614778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ce4ee421-990e-4f0f-96cd-03b3b96a22fa tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.836620 Sep 11 15:12:20.614778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1156 bytes} [Sun Sep 11 15:12:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 844 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:12:20.614778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1f18c18a-f7b7-4d31-8563-030c06496341 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Action: 'create', calling method: .version_select at 0x7f3938fabd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1854126741", "metadata": {"Type": "work"}}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1f18c18a-f7b7-4d31-8563-030c06496341 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Request method failure captured: Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 120 Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrTtH-pCQ1neQRsQoPcEHYi2SMOKQEhvKSWg1jm5_vhPQvf_tdMklUhhhtcrNrdHJezP9RtXJrDfLhJ4t_WZKyctzpnGHeyjq-d8X6A2rYCopIo9RkwsUHLM4Ms4upZUH5KvhTATuo0WmxK61oEt-U_WO_3G-knwN8kNhvSxfVCVFo Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:12:20.616808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_053104c5c4504dba86cd8749650f94b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 1121f5db549842a8b1b9b3bbaf0cfb42 Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1854126741", "metadata": {"Type": "work"}}} Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: Sep 11 15:12:20.620930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1854126741', 'metadata': {'Type': 'work'}}}} Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise error Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi '0' Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:12:20.623770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 15:12:20.629946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 15:12:20.637318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 15:12:20.637318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.637318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1f18c18a-f7b7-4d31-8563-030c06496341 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:12:20.637318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1f18c18a-f7b7-4d31-8563-030c06496341 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009263 Sep 11 15:12:20.637318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 2/2] 10.222.0.44 () {60 vars in 1156 bytes} [Sun Sep 11 15:12:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:12:20.637318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f326c28b-e514-4d1e-a015-49a22ee365d0 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Action: 'create', calling method: .version_select at 0x7f3938e63160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-908281693", "metadata": {"Type": "work"}}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:20.637318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f326c28b-e514-4d1e-a015-49a22ee365d0 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Request method failure captured: Sep 11 15:12:20.637318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 15:12:20.637318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 118 Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrTtH-pCQ1neQRsQoPcEHYi2SMOKQEhvKSWg1jm5_vhPQvf_tdMklUhhhtcrNrdHJezP9RtXJrDfLhJ4t_WZKyctzpnGHeyjq-d8X6A2rYCopIo9RkwsUHLM4Ms4upZUH5KvhTATuo0WmxK61oEt-U_WO_3G-knwN8kNhvSxfVCVFo Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:12:20.639232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_053104c5c4504dba86cd8749650f94b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 1121f5db549842a8b1b9b3bbaf0cfb42 Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-908281693", "metadata": {"Type": "work"}}} Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-908281693', 'metadata': {'Type': 'work'}}}} Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise error Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi '' Sep 11 15:12:20.646692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.652315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f326c28b-e514-4d1e-a015-49a22ee365d0 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f326c28b-e514-4d1e-a015-49a22ee365d0 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009040 Sep 11 15:12:20.656627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 3/3] 10.222.0.44 () {60 vars in 1156 bytes} [Sun Sep 11 15:12:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:12:20.658950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5a62c36c-8e9d-42b1-9ca8-02a4b27b7fd5 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Calling method '.version_select at 0x7f3938e63b80>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:20.690061 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d2c99e00-d674-41c2-b417-64b7d90b6694 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] Action: 'create', calling method: .version_select at 0x7f3938fa94c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-846805028", "metadata": {"Type": "work"}}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:20.955959 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-5a62c36c-8e9d-42b1-9ca8-02a4b27b7fd5 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] HTTP exception thrown: Volume tempest-invalid-1454357686 could not be found. Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5a62c36c-8e9d-42b1-9ca8-02a4b27b7fd5 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Request method failure captured: Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1454357686 HTTP/1.1 Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrTtH-pCQ1neQRsQoPcEHYi2SMOKQEhvKSWg1jm5_vhPQvf_tdMklUhhhtcrNrdHJezP9RtXJrDfLhJ4t_WZKyctzpnGHeyjq-d8X6A2rYCopIo9RkwsUHLM4Ms4upZUH5KvhTATuo0WmxK61oEt-U_WO_3G-knwN8kNhvSxfVCVFo Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:12:20.968350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_053104c5c4504dba86cd8749650f94b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 1121f5db549842a8b1b9b3bbaf0cfb42 Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Volume tempest-invalid-1454357686 could not be found. Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'tempest-invalid-1454357686'} Sep 11 15:12:20.969642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1454357686 could not be found. (HTTP 404) (Request-ID: req-d9eb2a61-e490-496e-a784-3e0bf3389a97) Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:20.970391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 15:12:20.971664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1454357686 could not be found. Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:12:20.972847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1454357686 could not be found. Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1454357686 could not be found. Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5a62c36c-8e9d-42b1-9ca8-02a4b27b7fd5 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Returning 404 to user: Volume tempest-invalid-1454357686 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5a62c36c-8e9d-42b1-9ca8-02a4b27b7fd5 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1454357686" status: 404 len: 99 microversion: 2.1 time: 0.329184 Sep 11 15:12:20.976540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 4/4] 10.222.0.44 () {58 vars in 1218 bytes} [Sun Sep 11 15:12:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1454357686 => generated 99 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 11 15:12:21.004612 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dcc42c4a-864e-4add-9d60-29d3e77adea0 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.021359 Sep 11 15:12:21.006860 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 5/5] 10.222.0.44 () {58 vars in 1140 bytes} [Sun Sep 11 15:12:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 11 15:12:21.017515 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-39e7e74a-67ac-436a-b883-fad9ef774374 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005260 Sep 11 15:12:21.019057 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 6/6] 10.222.0.44 () {58 vars in 1137 bytes} [Sun Sep 11 15:12:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 11 15:12:21.030492 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-19adacbc-7680-4b50-92ce-75fc4fe53ef8 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Calling method '.version_select at 0x7f3938deadc0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:21.181222 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-19adacbc-7680-4b50-92ce-75fc4fe53ef8 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] HTTP exception thrown: Volume e1108a00-99eb-4b5b-a463-210521aa3624 could not be found. Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-19adacbc-7680-4b50-92ce-75fc4fe53ef8 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Request method failure captured: Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/os-volumes/e1108a00-99eb-4b5b-a463-210521aa3624 HTTP/1.1 Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrTtH-pCQ1neQRsQoPcEHYi2SMOKQEhvKSWg1jm5_vhPQvf_tdMklUhhhtcrNrdHJezP9RtXJrDfLhJ4t_WZKyctzpnGHeyjq-d8X6A2rYCopIo9RkwsUHLM4Ms4upZUH5KvhTATuo0WmxK61oEt-U_WO_3G-knwN8kNhvSxfVCVFo Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:12:21.183224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_053104c5c4504dba86cd8749650f94b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 1121f5db549842a8b1b9b3bbaf0cfb42 Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Volume e1108a00-99eb-4b5b-a463-210521aa3624 could not be found. Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'e1108a00-99eb-4b5b-a463-210521aa3624'} Sep 11 15:12:21.184524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1108a00-99eb-4b5b-a463-210521aa3624 could not be found. (HTTP 404) (Request-ID: req-c00d0f61-0980-4a68-9d01-7aa38de61ed3) Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:21.185457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 15:12:21.186516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1108a00-99eb-4b5b-a463-210521aa3624 could not be found. Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 15:12:21.187631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1108a00-99eb-4b5b-a463-210521aa3624 could not be found. Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1108a00-99eb-4b5b-a463-210521aa3624 could not be found. Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-19adacbc-7680-4b50-92ce-75fc4fe53ef8 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Returning 404 to user: Volume e1108a00-99eb-4b5b-a463-210521aa3624 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-19adacbc-7680-4b50-92ce-75fc4fe53ef8 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/e1108a00-99eb-4b5b-a463-210521aa3624" status: 404 len: 109 microversion: 2.1 time: 0.161258 Sep 11 15:12:21.188701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 7/7] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:12:21 2022] DELETE /compute/v2.1/os-volumes/e1108a00-99eb-4b5b-a463-210521aa3624 => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:12:21.198390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3754847c-c4ee-4808-a34c-c0eebcac1e53 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938d97550>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:21.321691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3754847c-c4ee-4808-a34c-c0eebcac1e53 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/54e71c27-55e4-4724-bb47-47a8691ebcd4" status: 200 len: 351 microversion: 2.1 time: 0.112164 Sep 11 15:12:21.321691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 8/8] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:12:21 2022] GET /compute/v2.1/os-volumes/54e71c27-55e4-4724-bb47-47a8691ebcd4 => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:21.321691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e4bbad38-e3f0-468f-a34c-c33536b3fd98 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Calling method '.version_select at 0x7f3938d97ca0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:21.826185 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-e4bbad38-e3f0-468f-a34c-c33536b3fd98 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] HTTP exception thrown: Volume c4d286d6-cc08-4af4-9c65-f07c548e688f could not be found. Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e4bbad38-e3f0-468f-a34c-c33536b3fd98 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Request method failure captured: Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/os-volumes/c4d286d6-cc08-4af4-9c65-f07c548e688f HTTP/1.1 Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrTtH-pCQ1neQRsQoPcEHYi2SMOKQEhvKSWg1jm5_vhPQvf_tdMklUhhhtcrNrdHJezP9RtXJrDfLhJ4t_WZKyctzpnGHeyjq-d8X6A2rYCopIo9RkwsUHLM4Ms4upZUH5KvhTATuo0WmxK61oEt-U_WO_3G-knwN8kNhvSxfVCVFo Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:12:21.828151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_053104c5c4504dba86cd8749650f94b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/053104c5c4504dba86cd8749650f94b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 053104c5c4504dba86cd8749650f94b9 Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-431333071 Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 1121f5db549842a8b1b9b3bbaf0cfb42 Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-431333071-project Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Volume c4d286d6-cc08-4af4-9c65-f07c548e688f could not be found. Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'c4d286d6-cc08-4af4-9c65-f07c548e688f'} Sep 11 15:12:21.829469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4d286d6-cc08-4af4-9c65-f07c548e688f could not be found. (HTTP 404) (Request-ID: req-66961f0a-9f60-4b95-bdbb-ecc3435f7918) Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:21.830260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:12:21.832059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4d286d6-cc08-4af4-9c65-f07c548e688f could not be found. Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 15:12:21.834574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4d286d6-cc08-4af4-9c65-f07c548e688f could not be found. Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4d286d6-cc08-4af4-9c65-f07c548e688f could not be found. Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e4bbad38-e3f0-468f-a34c-c33536b3fd98 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] Returning 404 to user: Volume c4d286d6-cc08-4af4-9c65-f07c548e688f could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e4bbad38-e3f0-468f-a34c-c33536b3fd98 tempest-VolumesNegativeTest-431333071 tempest-VolumesNegativeTest-431333071-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c4d286d6-cc08-4af4-9c65-f07c548e688f" status: 404 len: 109 microversion: 2.1 time: 0.528267 Sep 11 15:12:21.837377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 9/9] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:12:21 2022] GET /compute/v2.1/os-volumes/c4d286d6-cc08-4af4-9c65-f07c548e688f => generated 109 bytes in 530 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:12:21.938313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d2c99e00-d674-41c2-b417-64b7d90b6694 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.463327 Sep 11 15:12:21.949966 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 1/10] 10.222.0.44 () {60 vars in 1156 bytes} [Sun Sep 11 15:12:19 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2478 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 15:12:21.959009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-650ac94e-dd38-47e3-ad88-1b4b62cbf058 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] Calling method '.version_select at 0x7f3938d97d30>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:22.104803 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-650ac94e-dd38-47e3-ad88-1b4b62cbf058 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c" status: 200 len: 352 microversion: 2.1 time: 0.149494 Sep 11 15:12:22.112237 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 10/11] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:12:21 2022] GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c => generated 352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:23.122338 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-073a01c7-4d80-493f-ada1-9b9a5fd90496 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938e783a0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:23.125954 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-099440fe-8f14-42f3-ab75-5d48e4a01580 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] Calling method '.version_select at 0x7f3938dea9d0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:23.268848 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-073a01c7-4d80-493f-ada1-9b9a5fd90496 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ca052f72-9811-49f8-a036-1e07acdb48c6" status: 200 len: 351 microversion: 2.1 time: 0.150896 Sep 11 15:12:23.269466 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 2/12] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:12:23 2022] GET /compute/v2.1/os-volumes/ca052f72-9811-49f8-a036-1e07acdb48c6 => generated 351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:23.285985 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-099440fe-8f14-42f3-ab75-5d48e4a01580 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c" status: 200 len: 353 microversion: 2.1 time: 0.170364 Sep 11 15:12:23.286582 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 11/13] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:12:23 2022] GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:23.300343 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e3d6154f-2558-4481-850b-6cc4e52ebd77 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] Calling method '.version_select at 0x7f3938e78af0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:23.400112 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e3d6154f-2558-4481-850b-6cc4e52ebd77 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c" status: 200 len: 353 microversion: 2.1 time: 0.103812 Sep 11 15:12:23.400747 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 3/14] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:12:23 2022] GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:23.419135 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7e97a3b7-3784-40b0-98b2-e12a9a5f4cf3 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] Calling method '.version_select at 0x7f3938d979d0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:23.634333 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7e97a3b7-3784-40b0-98b2-e12a9a5f4cf3 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c" status: 202 len: 0 microversion: 2.1 time: 0.218937 Sep 11 15:12:23.635334 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 12/15] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:12:23 2022] DELETE /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:12:23.646519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-51f2320b-3cbf-4220-82ee-ced090f9715e tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] Calling method '.version_select at 0x7f3938e161f0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:23.743121 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-51f2320b-3cbf-4220-82ee-ced090f9715e tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c" status: 200 len: 352 microversion: 2.1 time: 0.102913 Sep 11 15:12:23.743890 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 4/16] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:12:23 2022] GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:24.761748 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27aa884e-a495-486d-94ff-8184242398a9 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] Calling method '.version_select at 0x7f3938d97550>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:24.851657 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-27aa884e-a495-486d-94ff-8184242398a9 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] HTTP exception thrown: Volume 593bdac3-4924-4d4e-b996-84e94ee6123c could not be found. Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27aa884e-a495-486d-94ff-8184242398a9 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] Request method failure captured: Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c HTTP/1.1 Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrTtHzT2quMUjGPKPR-6VHKLFMNvovwHrBwICe0EoLNoBvFopii8FR_yLH2oqqyuZB-zTJdOGzLIeXPwQ7H68IMY0SiW5GHJcJFnRxfN5T33woQVf8UgqAr9mV9GqtDlGDyZZXuP8bPinr_EcAoa745DJWbaysi_GQbY7ZfbPY_3Po Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 3a9a84610b96408189df339505ac4e2d Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesGetTestJSON-264511790 Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:12:24.853961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3a9a84610b96408189df339505ac4e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3a9a84610b96408189df339505ac4e2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3a9a84610b96408189df339505ac4e2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3a9a84610b96408189df339505ac4e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesGetTestJSON-264511790 Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3a9a84610b96408189df339505ac4e2d Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesGetTestJSON-264511790 Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesGetTestJSON-264511790-project Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 8d5fa4dea79740708b0d897e70f7b47f Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesGetTestJSON-264511790-project Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Volume 593bdac3-4924-4d4e-b996-84e94ee6123c could not be found. Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '593bdac3-4924-4d4e-b996-84e94ee6123c'} Sep 11 15:12:24.854971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 593bdac3-4924-4d4e-b996-84e94ee6123c could not be found. (HTTP 404) (Request-ID: req-c8ea0157-3656-46a1-b25d-5277fa133d89) Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:24.855588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:12:24.856467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 593bdac3-4924-4d4e-b996-84e94ee6123c could not be found. Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 15:12:24.857342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 593bdac3-4924-4d4e-b996-84e94ee6123c could not be found. Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 593bdac3-4924-4d4e-b996-84e94ee6123c could not be found. Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27aa884e-a495-486d-94ff-8184242398a9 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] Returning 404 to user: Volume 593bdac3-4924-4d4e-b996-84e94ee6123c could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-27aa884e-a495-486d-94ff-8184242398a9 tempest-VolumesGetTestJSON-264511790 tempest-VolumesGetTestJSON-264511790-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c" status: 404 len: 109 microversion: 2.1 time: 0.102316 Sep 11 15:12:24.858166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 13/17] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:12:24 2022] GET /compute/v2.1/os-volumes/593bdac3-4924-4d4e-b996-84e94ee6123c => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:12:25.089927 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da46a939-2778-4c4d-8e03-4a8789a418ba tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938e78c10>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:25.230066 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-da46a939-2778-4c4d-8e03-4a8789a418ba tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0f08760f-c62e-41ec-b4de-c6c7d3f53ba1" status: 200 len: 350 microversion: 2.1 time: 0.147778 Sep 11 15:12:25.231267 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 5/18] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:12:25 2022] GET /compute/v2.1/os-volumes/0f08760f-c62e-41ec-b4de-c6c7d3f53ba1 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:25.249244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-852e1185-3bd9-45e3-acf0-c29b947bbb62 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938e63dc0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:25.487109 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-852e1185-3bd9-45e3-acf0-c29b947bbb62 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.245978 Sep 11 15:12:25.487698 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 14/19] 10.222.0.44 () {58 vars in 1134 bytes} [Sun Sep 11 15:12:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:25.509373 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d53ef583-a46d-4473-973e-4b1ea187f62f tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938e784c0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:25.816206 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d53ef583-a46d-4473-973e-4b1ea187f62f tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.315085 Sep 11 15:12:25.817164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 6/20] 10.222.0.44 () {58 vars in 1149 bytes} [Sun Sep 11 15:12:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:25.832852 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-730fe076-7870-4e6d-b6ed-2073ee5f73d7 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938deaca0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:26.029965 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-730fe076-7870-4e6d-b6ed-2073ee5f73d7 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.200969 Sep 11 15:12:26.030573 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 15/21] 10.222.0.44 () {58 vars in 1134 bytes} [Sun Sep 11 15:12:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:26.044648 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f1e144c7-2474-4dc7-b4d2-f440539d8b92 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938e16d30>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:26.194685 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f1e144c7-2474-4dc7-b4d2-f440539d8b92 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.154279 Sep 11 15:12:26.196119 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 7/22] 10.222.0.44 () {58 vars in 1167 bytes} [Sun Sep 11 15:12:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:26.212024 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2b7c30a4-2f43-4540-8b12-b84f3b64517b tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938da7160>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:26.455875 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2b7c30a4-2f43-4540-8b12-b84f3b64517b tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.247718 Sep 11 15:12:26.456679 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 16/23] 10.222.0.44 () {58 vars in 1170 bytes} [Sun Sep 11 15:12:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:26.471672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0452fd84-89c3-429f-b09a-c7d37b2a4276 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938e788b0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:26.656294 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0452fd84-89c3-429f-b09a-c7d37b2a4276 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.189229 Sep 11 15:12:26.656887 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 8/24] 10.222.0.44 () {58 vars in 1155 bytes} [Sun Sep 11 15:12:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:26.681441 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-783f2c7b-788b-43b1-8a68-569beec28c12 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938da78b0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:26.927313 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-783f2c7b-788b-43b1-8a68-569beec28c12 tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259232 Sep 11 15:12:26.928858 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 17/25] 10.222.0.44 () {58 vars in 1188 bytes} [Sun Sep 11 15:12:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:26.943018 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ebe5e903-3a5e-4a0f-945d-1d60071a1f1b tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] Calling method '.version_select at 0x7f3938e164c0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:27.153121 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ebe5e903-3a5e-4a0f-945d-1d60071a1f1b tempest-VolumesTestJSON-93558536 tempest-VolumesTestJSON-93558536-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.214584 Sep 11 15:12:27.166869 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 9/26] 10.222.0.44 () {58 vars in 1155 bytes} [Sun Sep 11 15:12:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:36.386811 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1694424798", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "networks": [{"uuid": "c4d0fd89-6f27-48b3-9e76-6aeb0d7ec6b4"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:36.664592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] validate_networks() for [('c4d0fd89-6f27-48b3-9e76-6aeb0d7ec6b4', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:12:37.152768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-41a48d22-f2b8-4db6-9809-a17dcd5029da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'create', calling method: .version_select at 0x7f3938e20820>, body: {"keypair": {"name": "tempest-keypair-176226477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNAMCKIjO+Snrh6AWRiAmu14oJQ3RNV6ZNgoCpdWvPZq2lUCa9mtaY/whix2h8AUGkCbZYJqfXgSXvmjfCF+4kF8v1tecXqpT4qVY++tFy1lNH39mpId3bwEqRlPqFWxw=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:37.345177 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-41a48d22-f2b8-4db6-9809-a17dcd5029da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Getting quotas for project 2273d07b98054e3987568fc043597b78. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:12:37.368515 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-41a48d22-f2b8-4db6-9809-a17dcd5029da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Getting quotas for user 5e4f8b13b66449cf849ff9cb73938c4c and project 2273d07b98054e3987568fc043597b78. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:12:37.542889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-41a48d22-f2b8-4db6-9809-a17dcd5029da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.948339 Sep 11 15:12:37.544200 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 10/27] 10.222.0.44 () {62 vars in 1200 bytes} [Sun Sep 11 15:12:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 950 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 11 15:12:38.062814 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fbd3a485-bf61-49a8-a610-e2dacb6fdff5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: .version_select at 0x7f3938df0940>, body: {"keypair": {"name": "tempest-keypair-1399691642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDdaQnJ+7JDCcfzqfPEZz9RzcaeMqqBJKWccfCYLt4vCe8uvT14PJ7Nlv2QGm1NfR1Dg2B+3FcvyLMddsL9ZpJsA/Wf7h4k92fO5Gk/faCrZZG/xCinxD0SdaTtmo0N0A=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:38.114918 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-fbd3a485-bf61-49a8-a610-e2dacb6fdff5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:12:38.127260 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-fbd3a485-bf61-49a8-a610-e2dacb6fdff5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for user c44105f2d90e469fb03f311a4cf1476f and project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:12:38.202120 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fbd3a485-bf61-49a8-a610-e2dacb6fdff5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.656552 Sep 11 15:12:38.211772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 11/28] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:12:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:40.269740 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:12:40.270297 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:12:40.270609 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:12:40.271005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:12:40.271567 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:12:40.297256 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:40.302192 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:40.302966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:40.305091 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:40.305957 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:40.310103 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:40.382555 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Getting quotas for project a9e42cc8e82e41e2a5a33ae922079bc8. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:12:40.393595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Getting quotas for user 3eb721f100f24930bafd056d29048561 and project a9e42cc8e82e41e2a5a33ae922079bc8. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:12:40.415602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:12:40.419039 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:12:40.577404 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b648991f-4ec0-46c2-88f0-150f19cabb42 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.797315 Sep 11 15:12:40.585181 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 18/29] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:12:40.594501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-54bcc9ec-0d9b-4d5d-a4e1-646bae79ca11 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:40.596681 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-54bcc9ec-0d9b-4d5d-a4e1-646bae79ca11 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:40.800204 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-54bcc9ec-0d9b-4d5d-a4e1-646bae79ca11 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:40.835887 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-54bcc9ec-0d9b-4d5d-a4e1-646bae79ca11 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1215 microversion: 2.1 time: 0.248852 Sep 11 15:12:40.840685 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 19/30] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:40 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:41.329650 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1444977282", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:41.520203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] validate_networks() for [('999c434d-8caa-4d39-8414-62eace84bdc9', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:12:41.863079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a2bf7419-f35f-49f9-b928-3d4c697fed87 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:41.864687 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a2bf7419-f35f-49f9-b928-3d4c697fed87 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:42.054845 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a2bf7419-f35f-49f9-b928-3d4c697fed87 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:42.062596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a2bf7419-f35f-49f9-b928-3d4c697fed87 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1215 microversion: 2.1 time: 0.204189 Sep 11 15:12:42.095375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 20/31] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:41 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:43.093225 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:43.095355 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:43.103780 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:43.104869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:43.105602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:43.107165 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:43.107834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:43.114273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:43.497766 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:43.541890 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9fd8f779-2676-4522-b450-98f35ee6a8e3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1219 microversion: 2.1 time: 0.451260 Sep 11 15:12:43.542667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 21/32] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:43 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1219 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:12:43.941098 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-53341323", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1578d7cc-1ac5-4c14-9f57-a1b6b975982d"}], "security_groups": [{"name": "tempest-securitygroup--410817257"}], "key_name": "tempest-keypair-176226477", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:44.005463 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:12:44.006817 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:12:44.008185 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:12:44.011266 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:12:44.012067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:12:44.055303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:44.055877 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:44.056402 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:44.057186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:44.059089 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:44.059826 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:44.101810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Getting quotas for project 7933806a47704d2d867be7312890b538. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:12:44.109725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Getting quotas for user 2bd47bf9aa4142b1b7ec8d02e8661578 and project 7933806a47704d2d867be7312890b538. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:12:44.124679 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:12:44.128768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:12:44.130839 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] validate_networks() for [('1578d7cc-1ac5-4c14-9f57-a1b6b975982d', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:12:44.215985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-71a682ac-5c21-4a15-9cf3-e107759d7bf8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.684121 Sep 11 15:12:44.217377 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 12/33] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:12:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 3686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 15:12:44.232355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d5c3c4ac-b691-49f3-a2bf-6b7601538d19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:44.233681 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d5c3c4ac-b691-49f3-a2bf-6b7601538d19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:44.400532 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d5c3c4ac-b691-49f3-a2bf-6b7601538d19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:44.471789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d5c3c4ac-b691-49f3-a2bf-6b7601538d19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1222 microversion: 2.1 time: 0.246088 Sep 11 15:12:44.476933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 13/34] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:44 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:12:44.576815 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:44.581065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:44.599584 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:44.605552 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:44.610856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:44.612501 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:44.614835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:44.615477 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:45.141694 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:45.172271 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3321dc9e-4543-4329-b682-4071c3b33f18 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1285 microversion: 2.1 time: 0.607945 Sep 11 15:12:45.175352 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 14/35] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:44 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1285 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:45.187366 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-279037147", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc5581c2-ebe9-4dd1-accb-09df241979bd"}], "security_groups": [{"name": "tempest-securitygroup--418164357"}], "key_name": "tempest-keypair-1399691642", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:45.222221 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:12:45.223607 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:12:45.224291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:12:45.225255 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:12:45.226222 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:12:45.243049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:45.245732 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:45.248332 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:45.249381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:45.249909 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:45.251717 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:45.274026 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Getting quotas for project 2273d07b98054e3987568fc043597b78. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:12:45.282099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Getting quotas for user 5e4f8b13b66449cf849ff9cb73938c4c and project 2273d07b98054e3987568fc043597b78. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:12:45.351702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:12:45.357113 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:12:45.471787 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5002865f-726f-494c-be88-889abe1b7407 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.535486 Sep 11 15:12:45.482770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 22/36] 10.222.0.44 () {62 vars in 1188 bytes} [Sun Sep 11 15:12:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 11 15:12:45.486718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] validate_networks() for [('fc5581c2-ebe9-4dd1-accb-09df241979bd', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:12:45.506458 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-231965199", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:45.685223 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] validate_networks() for [('999c434d-8caa-4d39-8414-62eace84bdc9', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:12:47.553628 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:12:47.554929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:12:47.555987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:12:47.565304 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:12:47.566290 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:12:47.603190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:47.607169 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:47.613294 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:47.621856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:47.622462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:47.624179 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:47.711702 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:12:47.726316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for user c44105f2d90e469fb03f311a4cf1476f and project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:12:47.756142 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:12:47.758771 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:12:47.889759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f6ac1c6e-ed99-4fc4-bc3c-8a7227b28055 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.708227 Sep 11 15:12:47.908364 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 15/37] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:12:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 2732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:12:47.923472 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:47.927052 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:47.961688 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:12:47.963500 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:12:47.964305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:12:47.965071 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:12:47.966295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:12:47.988520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:47.990161 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:47.991203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:47.992845 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:47.995045 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:47.997433 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:48.005069 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:48.007995 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:48.008469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:48.011550 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:48.013830 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:48.027594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:48.155131 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Getting quotas for project 7933806a47704d2d867be7312890b538. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:12:48.189396 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Getting quotas for user 2bd47bf9aa4142b1b7ec8d02e8661578 and project 7933806a47704d2d867be7312890b538. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:12:48.243278 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:12:48.265001 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:12:48.581732 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-19462165-d1f5-446d-ad5e-e3fef3097cfc tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.096331 Sep 11 15:12:48.597298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 23/38] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:12:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 3113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:12:48.626186 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:48.632303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:48.636990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:48.662243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:48.667359 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:48.671089 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:48.673436 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2c8bc46e-d74c-4f55-b600-e479f5c6f86c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1275 microversion: 2.20 time: 0.763270 Sep 11 15:12:48.674329 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:48.674970 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:48.676706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 16/39] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:12:47 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1275 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:12:48.680479 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:48.685863 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:48.686572 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:48.706051 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-63899ca9-7175-486e-91cd-d205468c0fb3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:48.718350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-63899ca9-7175-486e-91cd-d205468c0fb3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:49.160989 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-63899ca9-7175-486e-91cd-d205468c0fb3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:49.182535 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-63899ca9-7175-486e-91cd-d205468c0fb3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1241 microversion: 2.1 time: 0.490912 Sep 11 15:12:49.193518 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 17/40] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:48 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1241 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:49.209570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-df5a219e-60f7-4c4e-b7ba-62e74c17097c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:49.212786 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-df5a219e-60f7-4c4e-b7ba-62e74c17097c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:49.680464 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-df5a219e-60f7-4c4e-b7ba-62e74c17097c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:49.696779 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-df5a219e-60f7-4c4e-b7ba-62e74c17097c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1221 microversion: 2.1 time: 0.500622 Sep 11 15:12:49.701780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 18/41] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:49 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1221 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:49.722711 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:49.724793 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:49.746757 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:49.747252 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:49.747815 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:49.754278 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:49.755939 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:49.756405 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:50.387267 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:50.406031 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:50.413452 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:50.415341 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cb60ea4d-654d-41cc-9467-93aa3e9b3c14 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1339 microversion: 2.20 time: 0.712084 Sep 11 15:12:50.416913 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 19/42] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:12:49 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1339 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:12:50.422140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:50.423316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:50.450325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:50.450833 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:50.451278 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:50.452049 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:50.457128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:50.460574 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:50.855675 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:50.866528 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:50.871252 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-194f2f1f-900b-404f-adf0-3e61f31faaf4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1293 microversion: 2.1 time: 0.451517 Sep 11 15:12:50.882434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 20/43] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:50 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1293 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:50.895852 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-95d64c2f-f056-44f4-adae-596e81ddd611 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 2.297002 Sep 11 15:12:50.898768 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 24/44] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:48 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:50.899525 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:50.900190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:50.926064 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:50.931742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:50.933128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:50.937497 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:50.940342 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:50.941742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:51.204464 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:51.256545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-aaad0e5d-df46-4efe-aec1-a4ef67eda3c6 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1217 microversion: 2.1 time: 0.365357 Sep 11 15:12:51.259804 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 21/45] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:50 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1217 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:51.448440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:51.450677 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:51.466743 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:51.471247 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:51.476945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:51.478133 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:51.479653 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:51.480189 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:51.929226 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:51.929847 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:51.944558 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:51.945905 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:51.947566 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:51.948442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:51.978793 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:51.979437 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:52.915918 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:52.935332 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:52.950933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8621fb25-647e-4fb2-ac6b-9c90f2ebedfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1311 microversion: 2.1 time: 1.027861 Sep 11 15:12:52.981231 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 22/46] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:51 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1311 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:12:52.987840 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:53.008735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:53.010215 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1ec5e074-021d-4e9b-9323-052ca2ad9cca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1337 microversion: 2.20 time: 1.567219 Sep 11 15:12:53.013650 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 25/47] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:12:51 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1337 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:12:53.017603 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:53.020259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:53.049371 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:53.050245 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:53.062927 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:53.063436 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:53.065816 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:53.069448 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:53.072314 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:53.072782 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:53.073729 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:53.074550 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:53.077103 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:53.078528 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:53.092470 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:53.093613 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:53.628374 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:53.650499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6cd5b7a8-8b8c-4b1e-b887-13c703b77204 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1273 microversion: 2.1 time: 0.632545 Sep 11 15:12:53.653207 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 26/48] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:53 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1273 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:54.184400 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-f1c2aadf-55a6-4519-8845-43219f77ec4f req-3ea5ba7a-315c-445a-b3cc-3756611b27f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eebb35f8-6e3a-46d0-94f9-04805ef7dd48", "tag": "3955453b-d745-4ca9-8a2d-0ebfe00220d3"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:12:54.188035 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:54.211945 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-22aa403b-91fd-4153-80ac-88eb26ac9b2c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 1.223060 Sep 11 15:12:54.222262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 23/49] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:52 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:54.229721 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f1c2aadf-55a6-4519-8845-43219f77ec4f req-3ea5ba7a-315c-445a-b3cc-3756611b27f2 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:54.234057 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f1c2aadf-55a6-4519-8845-43219f77ec4f req-3ea5ba7a-315c-445a-b3cc-3756611b27f2 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:54.234692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f1c2aadf-55a6-4519-8845-43219f77ec4f req-3ea5ba7a-315c-445a-b3cc-3756611b27f2 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:54.250411 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:54.258108 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:54.276583 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:54.280053 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:54.280626 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:54.290214 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:54.297123 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:54.297848 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:54.301124 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-f1c2aadf-55a6-4519-8845-43219f77ec4f req-3ea5ba7a-315c-445a-b3cc-3756611b27f2 service nova] Creating event network-changed:3955453b-d745-4ca9-8a2d-0ebfe00220d3 for instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 on hv-cinder-83976 Sep 11 15:12:54.303483 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f1c2aadf-55a6-4519-8845-43219f77ec4f req-3ea5ba7a-315c-445a-b3cc-3756611b27f2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 15:12:54.304640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f1c2aadf-55a6-4519-8845-43219f77ec4f req-3ea5ba7a-315c-445a-b3cc-3756611b27f2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 15:12:54.308741 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f52fddd-444b-4ea0-a47f-a72d274bb737 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:54.310134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f52fddd-444b-4ea0-a47f-a72d274bb737 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:54.312761 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f52fddd-444b-4ea0-a47f-a72d274bb737 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:54.315434 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f52fddd-444b-4ea0-a47f-a72d274bb737 None None] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:54.317690 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f52fddd-444b-4ea0-a47f-a72d274bb737 None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:54.318771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f52fddd-444b-4ea0-a47f-a72d274bb737 None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:54.344627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.compute.rpcapi [None req-7f52fddd-444b-4ea0-a47f-a72d274bb737 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 15:12:54.350920 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f52fddd-444b-4ea0-a47f-a72d274bb737 None None] Releasing lock "compute-rpcapi-router" {{(pid=120740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 15:12:54.379473 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7f52fddd-444b-4ea0-a47f-a72d274bb737 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.706028 Sep 11 15:12:54.380140 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 27/50] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:12:54.388958 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:54.402214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:54.410453 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:54.411153 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:54.423263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:54.424499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:54.425216 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:54.425808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:54.426377 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:54.452036 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5da50410-27f2-4db0-adda-ad4afc90c960 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1299 microversion: 2.1 time: 0.228561 Sep 11 15:12:54.452961 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 24/51] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:54 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:54.648013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:54.669425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:54.671679 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:54.674327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-14419d7d-81ec-46d4-a364-2da5892f926a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1337 microversion: 2.20 time: 0.289093 Sep 11 15:12:54.675708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 28/52] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:12:54 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1337 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:12:54.691313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:54.691313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:54.702327 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:54.707042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:54.708637 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:54.711989 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:54.712762 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:54.719149 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:55.152482 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:55.174596 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6bb6f79b-bcc6-4dc4-bd13-a8ab3f3ce119 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1279 microversion: 2.1 time: 0.496695 Sep 11 15:12:55.178554 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 25/53] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:54 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1279 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:55.251991 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:55.252615 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:55.268063 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:55.273368 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:55.274360 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:55.275593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:55.279983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:55.281440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:55.486864 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:55.487487 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:55.500664 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:55.502878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:55.504711 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:55.505827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:55.507087 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:55.509594 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:56.459893 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:56.468115 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9196e65d-ec2a-41eb-a316-e4dd83cb033a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1299 microversion: 2.1 time: 0.984394 Sep 11 15:12:56.488247 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 26/54] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:55 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1299 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:56.502754 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:56.504132 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:56.517304 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:56.519611 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:56.522451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:56.523863 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:56.527591 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:56.528530 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:56.883477 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:56.906791 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-07e43dcc-bbe2-47a4-9703-6da36603fe6d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 1.664545 Sep 11 15:12:56.912712 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 29/55] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:55 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:56.917876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:56.928828 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:56.950379 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:56.958918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:56.958918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:56.958918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:56.958918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:56.959315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:57.470098 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:57.483315 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:57.484984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:57.486142 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-65be6aba-ee43-4bd1-af77-c27568639dea tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1337 microversion: 2.20 time: 0.996757 Sep 11 15:12:57.486720 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 27/56] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:12:56 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1337 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:12:57.554387 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:57.571230 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:57.593524 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:57.605966 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:57.606744 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:57.607666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:57.608294 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:57.608894 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:57.670737 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:58.115023 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:12:58.133812 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-37ef7987-0f63-4d08-b2ba-0992e91f0988 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1279 microversion: 2.1 time: 1.219265 Sep 11 15:12:58.135658 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 30/57] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:56 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1279 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:12:58.151656 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:12:58.166176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:12:58.185629 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:58.186452 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:58.187238 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:58.188289 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:12:58.189548 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:12:58.203331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:12:58.299834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=22 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:59.692881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=26 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:00.167607 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:00.180233 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3ba8eee8-8d4a-4e49-81d0-c662df12585f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 2.041118 Sep 11 15:13:00.181117 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 31/58] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:58 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:00.194766 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:00.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:00.207669 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:00.215501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:00.216428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:00.217360 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:00.218004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:00.218559 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:00.229377 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:00.238106 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-616d8e0f-2b83-4f21-8f7a-9294c84fc9e0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 2.699600 Sep 11 15:13:00.250165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 28/59] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:12:57 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 2712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:00.256608 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:00.264797 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:00.290589 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:00.293891 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:00.294577 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:00.295483 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:00.301939 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:00.305554 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:01.046804 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:01.061560 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-29929dd0-d823-4c30-99d6-817615fb27bb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.807313 Sep 11 15:13:01.062480 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 29/60] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:00 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:01.094153 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:01.105791 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:01.108495 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:01.110370 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e30e3e81-661f-482a-a0d6-0b5be7a30bc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.926566 Sep 11 15:13:01.111153 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 32/61] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:00 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:13:01.208849 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:01.209530 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:01.218763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:01.219517 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:01.222166 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:01.222166 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:01.222166 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:01.222166 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:01.276836 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:01.278495 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:01.296946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:01.297677 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:01.299661 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:01.303855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:01.306151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:01.310415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:01.759873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:01.777914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-348b059d-0352-47e2-b5e6-5f71674ccbf1 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 0.575108 Sep 11 15:13:01.778809 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 30/62] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:01 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:01.857350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:01.864979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-59920ce8-e5bf-42a5-a4e2-8b85bc50b90d req-fe4be23f-07db-437e-9b3a-ce8c06193c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d870f595-3d29-47d7-b4b4-6d51343a4acf", "tag": "5c7d6d35-d077-4f1f-a6ce-ab24e1a4b92a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:01.878651 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-51470d76-8c65-4cbe-ad12-c280efd84441 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.607594 Sep 11 15:13:01.891586 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 33/63] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:01 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:13:01.906013 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:01.923423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-59920ce8-e5bf-42a5-a4e2-8b85bc50b90d req-fe4be23f-07db-437e-9b3a-ce8c06193c50 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:01.923945 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-59920ce8-e5bf-42a5-a4e2-8b85bc50b90d req-fe4be23f-07db-437e-9b3a-ce8c06193c50 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:01.924514 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-59920ce8-e5bf-42a5-a4e2-8b85bc50b90d req-fe4be23f-07db-437e-9b3a-ce8c06193c50 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:01.983642 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-59920ce8-e5bf-42a5-a4e2-8b85bc50b90d req-fe4be23f-07db-437e-9b3a-ce8c06193c50 service nova] Creating event network-changed:5c7d6d35-d077-4f1f-a6ce-ab24e1a4b92a for instance d870f595-3d29-47d7-b4b4-6d51343a4acf on hv-cinder-83976 Sep 11 15:13:01.985440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-59920ce8-e5bf-42a5-a4e2-8b85bc50b90d req-fe4be23f-07db-437e-9b3a-ce8c06193c50 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 15:13:01.986429 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-59920ce8-e5bf-42a5-a4e2-8b85bc50b90d req-fe4be23f-07db-437e-9b3a-ce8c06193c50 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 15:13:01.988059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99127eeb-2d23-4532-8bcb-1a9567663885 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:01.988961 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99127eeb-2d23-4532-8bcb-1a9567663885 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:01.997151 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99127eeb-2d23-4532-8bcb-1a9567663885 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:01.998434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99127eeb-2d23-4532-8bcb-1a9567663885 None None] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:01.999049 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99127eeb-2d23-4532-8bcb-1a9567663885 None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:01.999729 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99127eeb-2d23-4532-8bcb-1a9567663885 None None] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:02.011788 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.compute.rpcapi [None req-99127eeb-2d23-4532-8bcb-1a9567663885 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 15:13:02.012870 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99127eeb-2d23-4532-8bcb-1a9567663885 None None] Releasing lock "compute-rpcapi-router" {{(pid=120739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 15:13:02.038738 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-99127eeb-2d23-4532-8bcb-1a9567663885 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257675 Sep 11 15:13:02.038738 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 31/64] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:13:02.088847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:02.089682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:02.104054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:02.105794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:02.106993 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:02.109815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:02.111539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:02.113398 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:02.140074 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:02.140783 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:02.155222 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:02.155722 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:02.156429 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:02.156881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:02.165576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:02.166165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:02.631438 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:02.640844 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e7c39afc-e020-4975-88f2-94c900c3d02b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.558202 Sep 11 15:13:02.661163 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 34/65] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:02 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:02.756412 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-9c82941a-a2af-4922-9eaf-4767a511163c req-48c8dced-f6b8-4686-83de-655e21a80544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cbd483-4673-4cba-a512-0585e93c4b00", "tag": "72bdc752-4b8d-42ff-ab81-964776f1883a"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:02.777556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9c82941a-a2af-4922-9eaf-4767a511163c req-48c8dced-f6b8-4686-83de-655e21a80544 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:02.784564 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9c82941a-a2af-4922-9eaf-4767a511163c req-48c8dced-f6b8-4686-83de-655e21a80544 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:02.785052 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9c82941a-a2af-4922-9eaf-4767a511163c req-48c8dced-f6b8-4686-83de-655e21a80544 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:02.833780 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-9c82941a-a2af-4922-9eaf-4767a511163c req-48c8dced-f6b8-4686-83de-655e21a80544 service nova] Creating event network-changed:72bdc752-4b8d-42ff-ab81-964776f1883a for instance 57cbd483-4673-4cba-a512-0585e93c4b00 on hv-cinder-83976 Sep 11 15:13:02.839787 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-9c82941a-a2af-4922-9eaf-4767a511163c req-48c8dced-f6b8-4686-83de-655e21a80544 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086920 Sep 11 15:13:02.840443 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 35/66] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:13:02.854145 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:02.855066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:02.864942 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:02.865573 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:02.866726 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:02.868339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:02.869114 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:02.869902 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:02.939555 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:02.954723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:02.956190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:02.961805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-01191af9-41c0-4933-b6d6-330f737a32e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.826103 Sep 11 15:13:02.963560 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 32/67] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:02 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:13:02.975807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:02.977848 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:02.992794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:02.995307 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:02.995791 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:02.996526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:02.996988 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:02.997443 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:03.047794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:03.570457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:03.583732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:03.591315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-866ba98b-8a1d-4fbc-9f4a-3240ae2e5422 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 0.742762 Sep 11 15:13:03.595497 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e0ef489f-3740-4528-8376-f020c7c97f1d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.630286 Sep 11 15:13:03.595724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 36/68] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:02 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:03.599108 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 33/69] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:02 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:03.677896 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:03.678764 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:03.686972 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:03.687643 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:03.688235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:03.689384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:03.690148 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:03.690571 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:03.863926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:03.874065 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-834e0d60-28fc-4748-b310-f2b64467667f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.202564 Sep 11 15:13:03.877176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 37/70] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:03 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:03.988093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:03.988985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:03.998657 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:03.999163 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:03.999623 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.000346 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:04.000793 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:04.001280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.072607 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-eb617631-42f4-4b4c-abd9-95c823422179 req-b74b3ed8-2d68-4b76-ada4-e49be0cdd123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8", "tag": "0ee60018-4df2-40cf-8323-5711c188966a"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:04.100768 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-eb617631-42f4-4b4c-abd9-95c823422179 req-b74b3ed8-2d68-4b76-ada4-e49be0cdd123 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:04.101900 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-eb617631-42f4-4b4c-abd9-95c823422179 req-b74b3ed8-2d68-4b76-ada4-e49be0cdd123 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:04.102574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-eb617631-42f4-4b4c-abd9-95c823422179 req-b74b3ed8-2d68-4b76-ada4-e49be0cdd123 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.130901 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-eb617631-42f4-4b4c-abd9-95c823422179 req-b74b3ed8-2d68-4b76-ada4-e49be0cdd123 service nova] Creating event network-changed:0ee60018-4df2-40cf-8323-5711c188966a for instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 on hv-cinder-83976 Sep 11 15:13:04.141430 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-eb617631-42f4-4b4c-abd9-95c823422179 req-b74b3ed8-2d68-4b76-ada4-e49be0cdd123 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084245 Sep 11 15:13:04.142220 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 38/71] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:13:04.206186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:04.217654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:04.219617 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:04.220853 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-25335fae-86d8-42f3-a45a-1930b7c93177 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.237117 Sep 11 15:13:04.221448 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 34/72] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:03 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:13:04.627153 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:04.627835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:04.629804 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:04.633057 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:04.637691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=8 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:04.648960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:04.649247 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:04.649706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:04.650229 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.650580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:04.651126 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:04.651649 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.651780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:04.652417 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.653699 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:04.654425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:04.655075 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.840587 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:04.852299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2efce01c-5f3f-4e30-a9ab-9b28a22aa622 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.233861 Sep 11 15:13:04.853618 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 35/73] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:04 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:04.880589 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-4789d0e8-bf67-4c64-b4a4-f4818b2aece0 req-d681c0a6-1c16-45af-8614-05e687163ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd773d7-015b-48eb-8a9d-d2616f33eef4", "tag": "62273584-e0b8-45ee-b16c-b73368a64b8f"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:04.907201 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:04.912355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4789d0e8-bf67-4c64-b4a4-f4818b2aece0 req-d681c0a6-1c16-45af-8614-05e687163ab1 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:04.915799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4789d0e8-bf67-4c64-b4a4-f4818b2aece0 req-d681c0a6-1c16-45af-8614-05e687163ab1 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:04.916310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4789d0e8-bf67-4c64-b4a4-f4818b2aece0 req-d681c0a6-1c16-45af-8614-05e687163ab1 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.917892 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9c35251c-582b-49e2-afe9-acb06cf7051c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 0.302683 Sep 11 15:13:04.926482 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 39/74] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:04 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:04.938206 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:04.938820 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:04.941380 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-4789d0e8-bf67-4c64-b4a4-f4818b2aece0 req-d681c0a6-1c16-45af-8614-05e687163ab1 service nova] Creating event network-changed:62273584-e0b8-45ee-b16c-b73368a64b8f for instance dcd773d7-015b-48eb-8a9d-d2616f33eef4 on hv-cinder-83976 Sep 11 15:13:04.948130 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:04.948879 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:04.949384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.950869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:04.951389 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:04.952025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:04.954231 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-4789d0e8-bf67-4c64-b4a4-f4818b2aece0 req-d681c0a6-1c16-45af-8614-05e687163ab1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077407 Sep 11 15:13:04.954897 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 36/75] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:13:04.973993 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:05.124368 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:05.133736 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-acba4691-3927-40a3-9395-8d0b7ff205de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.204939 Sep 11 15:13:05.149406 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 40/76] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:04 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:05.246933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:05.248298 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:05.260071 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:05.260747 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:05.261386 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:05.262251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:05.262855 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:05.263414 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:05.463983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:05.473886 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:05.475329 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:05.476665 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d366f82a-493b-47d7-9839-3e78577f9f87 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.234069 Sep 11 15:13:05.477916 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 37/77] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:05 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:13:05.877045 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:05.877836 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:05.880889 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:05.891910 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:05.898320 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:05.898320 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:05.898320 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:05.898320 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:05.900272 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:05.945443 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:05.945443 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:05.956981 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:05.957651 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:05.958104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:05.958816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:05.959266 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:05.967749 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:06.597459 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:06.611069 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7a3c43ba-9839-4d0c-a2db-dd7da4273b88 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 0.671789 Sep 11 15:13:06.613581 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 38/78] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:05 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:13:06.630136 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:06.631064 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:06.638016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:06.648478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-df84c662-9aae-43d1-97f3-4840ad8a8f69 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.775939 Sep 11 15:13:06.650976 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:06.655222 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 41/79] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:05 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:06.666088 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:06.666724 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:06.667487 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:06.667959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:06.668381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:06.669409 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:06.677672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:06.694461 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:06.703717 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:06.704197 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:06.707056 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:06.710284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:06.710938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:07.041577 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:07.054084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b1e48af0-558a-4c60-974d-e6919d59c00a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.436993 Sep 11 15:13:07.055864 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 39/80] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:06 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:07.065584 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:07.076336 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:07.078857 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:07.080326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d726c688-6a35-44ca-a6cb-78a2e9f41764 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.423424 Sep 11 15:13:07.081118 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 42/81] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:06 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:13:07.644091 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:07.644707 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:07.652519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:07.666636 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:07.668914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:07.669715 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:07.677476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:07.679016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:07.685322 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:07.688794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:07.702678 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:07.703176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:07.703609 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:07.704327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:07.704771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:07.708975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:07.973816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:07.983486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-978ec9a3-8997-4f78-9c65-bb44e7c4a618 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 0.343801 Sep 11 15:13:07.984405 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 40/82] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:07 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:07.988442 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:08.004345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-51b9d6ee-e066-4243-82a6-953756e02400 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.332169 Sep 11 15:13:08.004943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 43/83] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:07 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:13:08.080009 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:08.080864 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:08.088955 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:08.089835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:08.090611 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:08.091831 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:08.092636 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:08.093410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:08.108143 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:08.108797 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:08.130058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:08.130762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:08.131366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:08.132571 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:08.133268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:08.133947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:08.912625 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:08.916326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:08.949657 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c37c7696-8486-4db9-af78-e35eeff02de5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.874941 Sep 11 15:13:08.954618 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 41/84] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:08 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:08.971903 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:08.984636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:08.989728 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a4ade73a-1d3a-451a-916f-09dba410772a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.884933 Sep 11 15:13:08.990684 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 44/85] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:08 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:13:09.014147 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:09.014870 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:09.023355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:09.023355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:09.023355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:09.023898 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:09.024199 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:09.024644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:09.030212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:09.031171 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:09.042058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:09.042686 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:09.042983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:09.043698 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:09.051074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:09.051569 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:09.333041 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:09.352571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-07bfd841-82c7-4c88-877e-8e721c66813c tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 0.343187 Sep 11 15:13:09.367293 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 42/86] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:09 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:09.470612 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:09.488388 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dfa32bc7-dacc-423a-b94e-403e5195e40d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.462926 Sep 11 15:13:09.507787 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 45/87] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:09 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:09.981983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:09.985422 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:10.033566 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:10.037383 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:10.043289 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:10.045698 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:10.047542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-ca631681-065f-4375-b305-a894971dda63 req-5d0e89b5-8422-4902-9373-bfe995516fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eebb35f8-6e3a-46d0-94f9-04805ef7dd48", "name": "network-vif-plugged", "status": "completed", "tag": "3955453b-d745-4ca9-8a2d-0ebfe00220d3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:10.049215 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:10.050049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:10.073498 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ca631681-065f-4375-b305-a894971dda63 req-5d0e89b5-8422-4902-9373-bfe995516fea service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:10.075161 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ca631681-065f-4375-b305-a894971dda63 req-5d0e89b5-8422-4902-9373-bfe995516fea service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:10.076665 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ca631681-065f-4375-b305-a894971dda63 req-5d0e89b5-8422-4902-9373-bfe995516fea service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:10.108771 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-ca631681-065f-4375-b305-a894971dda63 req-5d0e89b5-8422-4902-9373-bfe995516fea service nova] Creating event network-vif-plugged:3955453b-d745-4ca9-8a2d-0ebfe00220d3 for instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 on hv-cinder-83976 Sep 11 15:13:10.123734 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-ca631681-065f-4375-b305-a894971dda63 req-5d0e89b5-8422-4902-9373-bfe995516fea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208547 Sep 11 15:13:10.125613 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 43/88] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:13:10.139400 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:10.141471 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:10.156506 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:10.157817 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:10.159232 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:10.170041 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:10.171435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:10.172496 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:10.444491 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:10.458695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8ad026a9-c88f-4ac4-8098-7060da0e576d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.480767 Sep 11 15:13:10.459289 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 46/89] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:09 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:13:10.463900 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:10.464512 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:10.481179 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:10.482896 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:10.483549 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:10.484741 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:10.485353 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:10.485837 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:10.498093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:10.518405 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:10.521974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:10.524956 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-41438ebb-aa9d-4eb2-ba75-f98e735dcbe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.396685 Sep 11 15:13:10.526208 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 44/90] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:10 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:13:10.575424 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:10.578046 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:10.592906 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:10.594141 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:10.594918 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:10.596163 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:10.597088 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:10.598320 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:10.657114 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:10.665863 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a0fcc0f3-5275-41f5-8980-39c27fc75141 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 0.205450 Sep 11 15:13:10.667016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 47/91] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:10 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:10.867832 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:10.968254 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9e2b24a2-2371-4f86-aa49-06ea4de8d674 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.418259 Sep 11 15:13:10.973121 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 45/92] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:10 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:11.490539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:11.491265 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:11.503381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:11.503954 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:11.505362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:11.508141 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:11.509423 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:11.518456 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:11.579133 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:11.579533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:11.598868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:11.598868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:11.598868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:11.598868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:11.599339 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:11.599339 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:11.874490 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:11.890194 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:11.891068 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b17207a9-7a4e-4e80-933f-a6951e327855 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.402928 Sep 11 15:13:11.891625 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 48/93] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:11 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:11.902012 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:11.905354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:11.905777 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:11.908359 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5d7af9bd-5a0b-4351-b0d7-16a5499ad6d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.332650 Sep 11 15:13:11.911053 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 46/94] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:11 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:13:11.913066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:11.934497 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:11.934997 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:11.935437 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:11.936168 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:11.936622 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:11.937045 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:12.001886 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:12.003406 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:12.011587 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:12.014167 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:12.015564 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:12.016398 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:12.017416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:12.018131 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:12.018934 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:12.314909 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:12.332485 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:12.341640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e1a4a357-680d-4358-a263-fcb609140472 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.348568 Sep 11 15:13:12.342932 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 47/95] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:11 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:13:12.349792 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-67eb3fcb-00ab-40ac-a683-443e0d668fc3 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 0.450461 Sep 11 15:13:12.352273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 49/96] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:11 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:12.916569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:12.917190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:12.923117 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:12.923599 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:12.924028 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:12.925952 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:12.926449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:12.927030 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:12.941284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:12.941284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:12.953432 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:12.953958 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:12.954387 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:12.955112 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:12.961350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:12.962596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:13.203277 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:13.216486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:13.216963 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:13.218876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:13.220410 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-178eaa71-bb50-493f-8935-0ff4f7b1fe5b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.285695 Sep 11 15:13:13.221556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 50/97] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:12 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:13:13.243410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-060009a5-dc4c-49da-9335-76b25068805d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.331322 Sep 11 15:13:13.244345 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 48/98] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:12 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:13.404809 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:13.405807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:13.407533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:13.408883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:13.416811 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:13.417624 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:13.418284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:13.419796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:13.420627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:13.421417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:13.421773 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:13.422711 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:13.423143 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:13.425280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:13.425790 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:13.426291 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:13.779399 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:13.792382 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c3effbab-4b6b-4127-91df-186adcc8d67d tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1315 microversion: 2.1 time: 0.385966 Sep 11 15:13:13.793601 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 49/99] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:13 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:13.803049 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-87c83f3c-a624-4eec-a60f-35c3b97239c4 req-7ba1ddfa-50df-408f-aed5-ae721f2315c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d870f595-3d29-47d7-b4b4-6d51343a4acf", "name": "network-vif-plugged", "status": "completed", "tag": "5c7d6d35-d077-4f1f-a6ce-ab24e1a4b92a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:13.830451 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:13.830592 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-87c83f3c-a624-4eec-a60f-35c3b97239c4 req-7ba1ddfa-50df-408f-aed5-ae721f2315c5 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:13.830959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-87c83f3c-a624-4eec-a60f-35c3b97239c4 req-7ba1ddfa-50df-408f-aed5-ae721f2315c5 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:13.831389 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-87c83f3c-a624-4eec-a60f-35c3b97239c4 req-7ba1ddfa-50df-408f-aed5-ae721f2315c5 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:13.846638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-87c83f3c-a624-4eec-a60f-35c3b97239c4 req-7ba1ddfa-50df-408f-aed5-ae721f2315c5 service nova] Creating event network-vif-plugged:5c7d6d35-d077-4f1f-a6ce-ab24e1a4b92a for instance d870f595-3d29-47d7-b4b4-6d51343a4acf on hv-cinder-83976 Sep 11 15:13:13.855664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4347ebfa-8e23-4b01-a834-cccc32a2bff7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.454671 Sep 11 15:13:13.870031 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 51/100] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:13 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:13.870114 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-87c83f3c-a624-4eec-a60f-35c3b97239c4 req-7ba1ddfa-50df-408f-aed5-ae721f2315c5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066376 Sep 11 15:13:13.870114 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 50/101] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:13:14.249044 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:14.249701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:14.256512 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:14.256981 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:14.257692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:14.258529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:14.259355 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:14.267974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:14.268665 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:14.274507 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:14.282232 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:14.282430 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:14.282983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:14.283694 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:14.284136 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:14.284583 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:14.540433 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:14.545369 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:14.554703 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b3498a50-36f2-4c79-906d-c5678b344c64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.291101 Sep 11 15:13:14.558103 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 51/102] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:14 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:14.563136 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:14.600983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:14.602580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:14.603769 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-04a3d18f-b3c2-4977-8b4c-1deaa528332b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.361371 Sep 11 15:13:14.604676 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 52/103] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:14 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:13:14.815570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:14.816618 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:14.823612 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:14.825034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:14.825698 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:14.826794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:14.827440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:14.827993 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:14.883864 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:14.885021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:14.892569 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:14.893045 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:14.893706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:14.894496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:14.894948 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:14.895627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:15.184374 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:15.200598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-70eb729f-8d86-4a3f-8739-3bfc0962373f tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1502 microversion: 2.1 time: 0.384109 Sep 11 15:13:15.220771 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 52/104] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:14 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1502 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:15.322170 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:15.366711 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b99faf59-1b96-4411-a1b1-3a5b6530977d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.487008 Sep 11 15:13:15.373498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 53/105] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:14 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:13:15.582742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:15.583954 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:15.597539 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:15.598144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:15.598660 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:15.600154 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:15.600863 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:15.601530 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:15.655036 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:15.657972 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:15.679255 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:15.680102 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:15.680715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:15.685280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:15.685766 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:15.689993 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:16.033929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:16.042050 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4849a987-469e-40c4-8571-188c1f462c7b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.464080 Sep 11 15:13:16.057536 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 53/106] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:15 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:16.063934 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-4418816c-ca84-40ea-bdd1-498bea4ad95b req-38e4702a-1713-45fd-abb9-138adc5a80c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cbd483-4673-4cba-a512-0585e93c4b00", "name": "network-vif-plugged", "status": "completed", "tag": "72bdc752-4b8d-42ff-ab81-964776f1883a"}, {"server_uuid": "35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8", "name": "network-vif-plugged", "status": "completed", "tag": "0ee60018-4df2-40cf-8323-5711c188966a"}, {"server_uuid": "dcd773d7-015b-48eb-8a9d-d2616f33eef4", "name": "network-vif-plugged", "status": "completed", "tag": "62273584-e0b8-45ee-b16c-b73368a64b8f"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:16.066735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:16.077061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:16.077724 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4418816c-ca84-40ea-bdd1-498bea4ad95b req-38e4702a-1713-45fd-abb9-138adc5a80c7 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:16.078472 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4418816c-ca84-40ea-bdd1-498bea4ad95b req-38e4702a-1713-45fd-abb9-138adc5a80c7 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:16.078927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:16.079380 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4418816c-ca84-40ea-bdd1-498bea4ad95b req-38e4702a-1713-45fd-abb9-138adc5a80c7 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:16.080226 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-48ba1788-c4a3-41ad-a0c3-2a06d46676a3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.433022 Sep 11 15:13:16.081122 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 54/107] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:15 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:13:16.096349 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-4418816c-ca84-40ea-bdd1-498bea4ad95b req-38e4702a-1713-45fd-abb9-138adc5a80c7 service nova] Creating event network-vif-plugged:72bdc752-4b8d-42ff-ab81-964776f1883a for instance 57cbd483-4673-4cba-a512-0585e93c4b00 on hv-cinder-83976 Sep 11 15:13:16.097064 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-4418816c-ca84-40ea-bdd1-498bea4ad95b req-38e4702a-1713-45fd-abb9-138adc5a80c7 service nova] Creating event network-vif-plugged:0ee60018-4df2-40cf-8323-5711c188966a for instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 on hv-cinder-83976 Sep 11 15:13:16.097994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-4418816c-ca84-40ea-bdd1-498bea4ad95b req-38e4702a-1713-45fd-abb9-138adc5a80c7 service nova] Creating event network-vif-plugged:62273584-e0b8-45ee-b16c-b73368a64b8f for instance dcd773d7-015b-48eb-8a9d-d2616f33eef4 on hv-cinder-83976 Sep 11 15:13:16.106789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-4418816c-ca84-40ea-bdd1-498bea4ad95b req-38e4702a-1713-45fd-abb9-138adc5a80c7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047641 Sep 11 15:13:16.107694 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 54/108] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:13:16.394005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:16.394639 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:16.400869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:16.401625 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:16.402192 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:16.403026 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:16.403837 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:16.404443 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:16.608084 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:16.616309 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f7be220b-588d-4855-a3f1-50d513a75701 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.226468 Sep 11 15:13:16.617235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 55/109] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:16 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:17.042314 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7192fc5a-578b-42ee-bfde-fd1cf9450a66 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0964e6ed-87d3-4c89-9db3-0b75fef018ac"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:17.045426 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7192fc5a-578b-42ee-bfde-fd1cf9450a66 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:17.054040 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7192fc5a-578b-42ee-bfde-fd1cf9450a66 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:17.054547 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7192fc5a-578b-42ee-bfde-fd1cf9450a66 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:17.055256 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7192fc5a-578b-42ee-bfde-fd1cf9450a66 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:17.055984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7192fc5a-578b-42ee-bfde-fd1cf9450a66 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:17.056434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7192fc5a-578b-42ee-bfde-fd1cf9450a66 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:17.056851 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7192fc5a-578b-42ee-bfde-fd1cf9450a66 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:17.069241 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:17.070204 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:17.079717 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:17.080539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:17.081171 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:17.082050 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:17.082697 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:17.083285 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:17.286420 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:17.289909 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:17.296065 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-adca412a-4a83-4d31-ab27-f966d92ad699 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.230715 Sep 11 15:13:17.297067 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 56/110] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:17 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:17.302242 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:17.302928 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:17.310114 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:17.310888 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:17.311519 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:17.312407 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:17.313072 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:17.313477 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:17.795960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:17.807297 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:17.807297 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:17.807815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-674314aa-7c29-48db-b9f9-bf65ab24028a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1404 microversion: 2.20 time: 0.509425 Sep 11 15:13:17.813173 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 57/111] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:17 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:13:17.837854 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:17.840586 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:17.848587 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:17.849165 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:17.849640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:17.850400 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:17.850874 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:17.851400 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:18.042112 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:18.052272 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-74d2bbcc-d505-4ca9-801f-52c3efce3e8b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.241973 Sep 11 15:13:18.061797 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 58/112] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:17 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:18.319806 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:18.320339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:18.327926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:18.328423 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:18.328909 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:18.330332 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:18.330944 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:18.331372 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:18.492808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:18.501835 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5f52b333-f00e-46b0-8473-5ae1f8262c12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1321 microversion: 2.1 time: 0.186116 Sep 11 15:13:18.502468 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 59/113] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:18 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:13:18.835641 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:18.836302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:18.843151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:18.843966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:18.844670 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:18.845545 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:18.846104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:18.846603 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:19.043368 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:19.054075 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:19.055710 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:19.057096 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4bce0398-7644-49a9-90e7-d9598190e19e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1596 microversion: 2.20 time: 0.225405 Sep 11 15:13:19.057589 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 60/114] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:13:18 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1596 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:13:19.081593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:19.083666 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:19.119862 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:19.120356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:19.120837 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:19.121587 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:19.123800 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:19.124478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:19.304926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:19.313965 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e1196b61-c2a6-4545-a1d7-371ff028dbc4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1366 microversion: 2.1 time: 0.242221 Sep 11 15:13:19.315344 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 61/115] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:19 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:19.320478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-501aa97a-bf17-427e-b789-09e517107a8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:19.321066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-501aa97a-bf17-427e-b789-09e517107a8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:19.327662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-501aa97a-bf17-427e-b789-09e517107a8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:19.329009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-501aa97a-bf17-427e-b789-09e517107a8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:19.329919 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-501aa97a-bf17-427e-b789-09e517107a8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:19.330987 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-501aa97a-bf17-427e-b789-09e517107a8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:19.331611 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-501aa97a-bf17-427e-b789-09e517107a8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:19.332220 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-501aa97a-bf17-427e-b789-09e517107a8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:19.545000 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-501aa97a-bf17-427e-b789-09e517107a8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.227696 Sep 11 15:13:19.545938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 62/116] 10.222.0.44 () {60 vars in 1316 bytes} [Sun Sep 11 15:13:19 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:13:19.576296 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:19.577647 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:19.609338 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:19.610127 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:19.614810 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:19.622662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:19.625021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:19.632946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:19.912822 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:19.923341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9052e14b-95cd-4a53-9503-082e1e3c317e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1515 microversion: 2.1 time: 0.376166 Sep 11 15:13:19.926062 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 63/117] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:19 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1515 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:19.953689 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:19.957096 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:19.966384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:19.967018 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:19.967699 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:19.968430 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:19.968874 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:19.969586 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:19.998215 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lazy-loading 'flavor' on Instance uuid dcd773d7-015b-48eb-8a9d-d2616f33eef4 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:13:20.173257 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-47bcd787-176d-41dd-b097-fa3e7681a766 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4/action" status: 200 len: 32 microversion: 2.1 time: 0.220619 Sep 11 15:13:20.174305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 64/118] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:13:19 2022] POST /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4/action => generated 32 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 15:13:20.189248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:20.190850 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:20.200153 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:20.200702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:20.202097 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:20.203514 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:20.204459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:20.205597 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:20.434836 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:20.452775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2d379e42-07e9-4b27-bd4f-c58e007a3cc2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.269316 Sep 11 15:13:20.453451 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 65/119] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:20 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:20.461868 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:20.463097 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:20.473665 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:20.474361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:20.474941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:20.475832 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:20.476418 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:20.477194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:20.728023 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:20.742075 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8a15cdc1-25e0-4f00-9800-93db5438801e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1557 microversion: 2.1 time: 0.286333 Sep 11 15:13:20.742774 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 66/120] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:20 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1557 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:20.773788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f9d6b166-321b-482a-8f2c-84c3151c7bbf tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:20.774554 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f9d6b166-321b-482a-8f2c-84c3151c7bbf tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:20.782224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9d6b166-321b-482a-8f2c-84c3151c7bbf tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:20.782989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9d6b166-321b-482a-8f2c-84c3151c7bbf tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:20.783649 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9d6b166-321b-482a-8f2c-84c3151c7bbf tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:20.785244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9d6b166-321b-482a-8f2c-84c3151c7bbf tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:20.786749 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9d6b166-321b-482a-8f2c-84c3151c7bbf tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:20.787521 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9d6b166-321b-482a-8f2c-84c3151c7bbf tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:20.927722 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7192fc5a-578b-42ee-bfde-fd1cf9450a66 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "POST /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.889889 Sep 11 15:13:20.928920 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 55/121] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:13:17 2022] POST /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48/os-volume_attachments => generated 194 bytes in 3892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:13:20.953423 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f9d6b166-321b-482a-8f2c-84c3151c7bbf tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.190788 Sep 11 15:13:20.954262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 67/122] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 15:13:20 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:13:21.481729 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:21.482769 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:21.496522 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:21.497378 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:21.498118 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:21.498949 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:21.499547 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:21.500255 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:21.884835 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-f1e090fd-3ad4-4074-b81b-9f6f6a42a243 req-df9ad097-b1e7-495b-afc7-36a9a454b631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8", "tag": "0ee60018-4df2-40cf-8323-5711c188966a"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:21.895770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f1e090fd-3ad4-4074-b81b-9f6f6a42a243 req-df9ad097-b1e7-495b-afc7-36a9a454b631 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:21.896510 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f1e090fd-3ad4-4074-b81b-9f6f6a42a243 req-df9ad097-b1e7-495b-afc7-36a9a454b631 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:21.897377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f1e090fd-3ad4-4074-b81b-9f6f6a42a243 req-df9ad097-b1e7-495b-afc7-36a9a454b631 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:21.913697 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-f1e090fd-3ad4-4074-b81b-9f6f6a42a243 req-df9ad097-b1e7-495b-afc7-36a9a454b631 service nova] Creating event network-changed:0ee60018-4df2-40cf-8323-5711c188966a for instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 on hv-cinder-83976 Sep 11 15:13:21.920066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-f1e090fd-3ad4-4074-b81b-9f6f6a42a243 req-df9ad097-b1e7-495b-afc7-36a9a454b631 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039865 Sep 11 15:13:21.920725 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 68/123] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:13:22.083306 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:22.092355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d3771e94-ee77-4c7c-b7e3-d9efa08fd641 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.616294 Sep 11 15:13:22.093284 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 56/124] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:21 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:22.932972 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-d3569a42-1060-41e4-807e-f1a4557f325d req-af5c4e51-ff93-44c8-83c9-58bf877181e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cbd483-4673-4cba-a512-0585e93c4b00", "tag": "72bdc752-4b8d-42ff-ab81-964776f1883a"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:22.961178 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d3569a42-1060-41e4-807e-f1a4557f325d req-af5c4e51-ff93-44c8-83c9-58bf877181e4 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:22.961805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d3569a42-1060-41e4-807e-f1a4557f325d req-af5c4e51-ff93-44c8-83c9-58bf877181e4 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:22.962344 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d3569a42-1060-41e4-807e-f1a4557f325d req-af5c4e51-ff93-44c8-83c9-58bf877181e4 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:22.975565 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-d3569a42-1060-41e4-807e-f1a4557f325d req-af5c4e51-ff93-44c8-83c9-58bf877181e4 service nova] Creating event network-changed:72bdc752-4b8d-42ff-ab81-964776f1883a for instance 57cbd483-4673-4cba-a512-0585e93c4b00 on hv-cinder-83976 Sep 11 15:13:22.985520 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-d3569a42-1060-41e4-807e-f1a4557f325d req-af5c4e51-ff93-44c8-83c9-58bf877181e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056358 Sep 11 15:13:22.986549 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 69/125] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:13:23.115855 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:23.117036 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:23.130147 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:23.130931 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:23.131677 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:23.132539 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:23.133127 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:23.133789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:23.322354 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:23.335756 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-21781190-ca88-4409-be91-1fd6f883b90c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.223779 Sep 11 15:13:23.336499 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 57/126] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:23 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:24.367780 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:24.369430 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:24.378455 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:24.379055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:24.379568 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:24.380337 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:24.380886 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:24.381365 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:24.542102 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:24.552719 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b5f4514c-a108-4b97-a78d-aa9425125b09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.191971 Sep 11 15:13:24.553636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 70/127] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:24 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:25.579236 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:25.580084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:25.586857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:25.587339 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:25.587763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:25.588451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:25.588900 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:25.589348 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:25.754525 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:25.766069 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b0257316-10a8-4091-a782-6c57065a3ccf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.193657 Sep 11 15:13:25.781692 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 58/128] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:25 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:26.793563 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:26.794151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:26.800605 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:26.801091 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:26.801562 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:26.802256 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:26.802701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:26.803210 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:26.942152 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:26.950929 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-287b49ee-aafe-4e5f-8671-0f3f2e03d79c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.162363 Sep 11 15:13:26.951531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 71/129] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:26 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:27.973794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:27.974411 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:27.981447 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:27.981933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:27.982430 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:27.983140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:27.983506 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:27.983939 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:28.116314 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:28.124422 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7c0715f9-6000-479e-9a97-1b96e04c5660 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.154569 Sep 11 15:13:28.124985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 59/130] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:27 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:29.146891 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:29.147644 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:29.153876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:29.154390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:29.154873 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:29.155663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:29.156207 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:29.156867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:29.291869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:29.299683 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0526e0f3-eb22-4f15-b695-2a71cde67245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.156760 Sep 11 15:13:29.300262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 72/131] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:29 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:30.322527 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:30.323102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:30.330403 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:30.330886 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:30.331335 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:30.332014 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:30.332478 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:30.332892 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:30.476856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:30.485313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8eea15b0-1506-44dd-b69c-96adc0d1dadd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.166869 Sep 11 15:13:30.485951 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 60/132] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:30 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:31.509567 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:31.510279 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:31.517036 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:31.517886 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:31.518191 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:31.519218 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:31.519893 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:31.520450 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:31.541095 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:31.678987 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:31.690212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d4136f00-14fe-4348-a0e1-fc516d3a5896 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.185605 Sep 11 15:13:31.691351 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 73/133] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:31 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:32.718105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:32.718867 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:32.721298 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=59 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:32.726683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:32.727230 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:32.727718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:32.728274 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:32.728724 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:32.729149 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:32.866446 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:32.874585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-54d24214-d387-4e3b-aa0e-9bfae4614414 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.160207 Sep 11 15:13:32.875272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 61/134] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:32 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:33.897653 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:33.898263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:33.905656 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:33.906334 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:33.906909 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:33.907839 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:33.908419 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:33.908961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:34.058047 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:34.066184 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b91a04be-38da-4471-9b8d-aea150ee1dd1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.172672 Sep 11 15:13:34.066778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 74/135] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:33 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:35.089818 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:35.090280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:35.097003 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:35.097532 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:35.097954 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:35.098637 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:35.099097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:35.099665 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:35.234336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:35.245572 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f541c03b-09f8-461b-b440-0870ac347b12 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.159624 Sep 11 15:13:35.246277 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 62/136] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:35 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:36.269356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:36.277339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:36.279477 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=68 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:36.285349 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:36.285835 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:36.286263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:36.286955 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:36.287396 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:36.287989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:36.430029 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:36.437836 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bff2415a-3d3f-49cf-beca-d2950fd116f3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.173652 Sep 11 15:13:36.438413 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 75/137] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:36 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:37.461886 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:37.462541 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:37.470060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:37.470899 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:37.471132 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:37.471854 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:37.472355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:37.472776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:37.616733 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:37.624753 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f49a8b5e-08d0-4dee-bcc6-c343ea3ecb4c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.167484 Sep 11 15:13:37.625372 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 63/138] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:37 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:38.441764 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:38.443683 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:38.461355 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:38.461915 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:38.462349 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:38.463478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:38.464336 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:38.465024 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:38.494595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:13:38.607726 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4c2c6c74-4023-4fc6-b6f1-5f4843c0db4e tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 204 len: 0 microversion: 2.1 time: 0.173891 Sep 11 15:13:38.608497 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 76/139] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:13:38 2022] DELETE /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:13:38.616692 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:38.617338 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:38.623796 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:38.624285 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:38.624722 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:38.625442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:38.625892 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:38.626313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:38.650363 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:38.651302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:38.658137 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:38.658864 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:38.659443 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:38.660417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:38.660762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:38.661207 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:38.850060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:38.856127 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:38.859167 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8cae95db-da84-43fb-b5d9-07e22128b900 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1554 microversion: 2.1 time: 0.246340 Sep 11 15:13:38.859913 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 64/140] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:38 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:38.864619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5a7f5892-1287-4943-b56d-2f6677d962ba tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.220249 Sep 11 15:13:38.877363 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 77/141] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:38 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:13:39.884156 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:39.884742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:39.887827 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:39.888696 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:39.891878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:39.892364 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:39.892813 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:39.893524 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:39.893966 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:39.894362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:39.895935 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:39.896904 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:39.897782 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:39.898644 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:39.899753 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:39.899753 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:40.099032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:40.103290 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:40.108213 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-835a8750-6563-4aa2-b0a2-fd35af250570 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1554 microversion: 2.1 time: 0.227959 Sep 11 15:13:40.108867 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 65/142] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:39 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:40.112098 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4fb62fd5-23ff-4562-8d87-55bd29babb94 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.228613 Sep 11 15:13:40.112772 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 78/143] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:39 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:41.130911 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:41.131446 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:41.135044 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:41.135678 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:41.138849 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:41.139313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:41.139765 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:41.140444 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:41.141046 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:41.141501 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:41.142281 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:41.142746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:41.143176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:41.143850 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:41.144525 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:41.144935 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:41.339898 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:41.344471 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:41.349128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ed26d69e-14b0-4edc-987e-2afc9fa71fad tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1554 microversion: 2.1 time: 0.222142 Sep 11 15:13:41.349747 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 66/144] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:41 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:41.353045 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9ad87bf3-de94-45b1-9dda-735efce8ad2c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.221910 Sep 11 15:13:41.353818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 79/145] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:41 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:42.374686 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:42.375487 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:42.376540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:42.377757 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:42.382859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:42.383367 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:42.383794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:42.384498 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:42.384941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:42.385400 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:42.392941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:42.393474 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:42.393900 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:42.394596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:42.395062 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:42.395472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:42.597279 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:42.600953 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:42.604118 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:42.607614 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-13e04bb1-4f38-4603-809e-b9604b902bc0 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1554 microversion: 2.1 time: 0.239089 Sep 11 15:13:42.608195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 67/146] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:42 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:42.612263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ccaf25d1-f5d1-4a7f-8856-5511c8f942b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.239885 Sep 11 15:13:42.612802 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 80/147] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:42 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:43.634639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:43.635981 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:43.641021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:43.642203 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:43.647735 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:43.648388 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:43.649002 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:43.650207 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:43.651226 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:43.651955 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:43.653158 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:43.654232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:43.655243 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:43.656473 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:43.657287 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:43.658213 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:43.976814 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:43.983793 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:43.991570 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-04d0c7ae-aee6-4089-9716-5f73ee2c261c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.357451 Sep 11 15:13:43.998185 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 81/148] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:43 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:44.000642 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-40a1f7b9-4bc2-4d36-99b1-fcea306d0c29 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1554 microversion: 2.1 time: 0.372191 Sep 11 15:13:44.006715 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 68/149] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:43 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1554 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:45.033977 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:45.034695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:45.043872 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:45.048764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:45.057050 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:45.059173 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:45.059800 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:45.060948 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:45.060948 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:45.063805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:45.070508 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:45.071944 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:45.072922 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:45.075222 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:45.076930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:45.079050 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:45.389476 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:45.435048 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-80ebf8b2-0284-4c16-ba98-c67282647100 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1512 microversion: 2.1 time: 0.397786 Sep 11 15:13:45.449186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 69/150] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:45 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:45.475632 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-01e16729-80af-41bc-bbc9-db73ba5638a5 req-cea413bc-6b05-45a6-86b6-0cb49f4e8228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eebb35f8-6e3a-46d0-94f9-04805ef7dd48", "name": "network-vif-deleted", "tag": "3955453b-d745-4ca9-8a2d-0ebfe00220d3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:13:45.509256 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-01e16729-80af-41bc-bbc9-db73ba5638a5 req-cea413bc-6b05-45a6-86b6-0cb49f4e8228 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:45.510100 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-01e16729-80af-41bc-bbc9-db73ba5638a5 req-cea413bc-6b05-45a6-86b6-0cb49f4e8228 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:45.510837 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-01e16729-80af-41bc-bbc9-db73ba5638a5 req-cea413bc-6b05-45a6-86b6-0cb49f4e8228 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:45.544869 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-01e16729-80af-41bc-bbc9-db73ba5638a5 req-cea413bc-6b05-45a6-86b6-0cb49f4e8228 service nova] Creating event network-vif-deleted:3955453b-d745-4ca9-8a2d-0ebfe00220d3 for instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 on hv-cinder-83976 Sep 11 15:13:45.569153 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:45.582984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-01e16729-80af-41bc-bbc9-db73ba5638a5 req-cea413bc-6b05-45a6-86b6-0cb49f4e8228 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134586 Sep 11 15:13:45.586153 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 70/151] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:13:45.587032 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4058e959-3cfb-47f1-ad2e-79e77a699ef5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.561337 Sep 11 15:13:45.588331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 82/152] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:45 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:46.483434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:46.486393 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:46.515009 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:46.516290 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:46.517287 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:46.520321 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:46.522144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:46.534899 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:46.640436 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:46.642220 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:46.642463 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:46.643418 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:46.644345 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:46.645342 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lazy-loading 'fault' on Instance uuid eebb35f8-6e3a-46d0-94f9-04805ef7dd48 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:13:46.661624 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:46.665363 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:46.667312 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:46.670067 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:46.671943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:46.672644 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:46.792485 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb721f100f24930bafd056d29048561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e42cc8e82e41e2a5a33ae922079bc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:46.841553 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ae822052-e818-45ad-9353-4184be2cdc0a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 200 len: 1351 microversion: 2.1 time: 0.368551 Sep 11 15:13:46.854914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 71/153] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:46 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 1351 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:47.029073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:47.051696 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a678c150-406f-44aa-9c06-354ef9694570 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.425599 Sep 11 15:13:47.075327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 83/154] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:46 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:47.889269 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:47.889269 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:47.901428 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:47.901428 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:47.901717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:47.902876 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:47.903752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:47.904486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:47.925696 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] HTTP exception thrown: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Request method failure captured: Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 HTTP/1.1 Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfriMfdmuptlZVY2S9ypFDMQa2gK6EcWkWml1HkbMvMinzl_YKPGIG7GJOWhbOE0lmk04F6ANE0PCZeJ2FcKVyAHNv1VAJJaWXyPnyFp2S8bl2Z_bvEeBtmZxaKeLAfXL1ld_Zycq5temc2E_--EVr_PxWH-Vgp9UyyyLS87yjrT17g Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: a9e42cc8e82e41e2a5a33ae922079bc8 Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:13:47.930936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: a9e42cc8e82e41e2a5a33ae922079bc8 Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-DeleteServersTestJSON-1367510814-project Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 3eb721f100f24930bafd056d29048561 Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-DeleteServersTestJSON-1367510814-project Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:47.933941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'eebb35f8-6e3a-46d0-94f9-04805ef7dd48'} Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:13:47.935640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:47.938434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:47.941772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Returning 404 to user: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:13:47.941772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d60611fc-c4c0-4cf9-ac0e-ae8271f07088 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 404 len: 111 microversion: 2.1 time: 0.051910 Sep 11 15:13:47.941772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 72/155] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:47 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:13:48.084477 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:48.088175 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:48.098205 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:48.099476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:48.100019 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:48.100540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:48.101377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:48.102647 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:48.103577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:48.104422 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:48.113543 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:48.114857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:48.115861 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:48.117837 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:48.118517 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:48.119248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:48.127273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] HTTP exception thrown: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Request method failure captured: Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48/os-volume_attachments HTTP/1.1 Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfriMfdmuptlZVY2S9ypFDMQa2gK6EcWkWml1HkbMvMinzl_YKPGIG7GJOWhbOE0lmk04F6ANE0PCZeJ2FcKVyAHNv1VAJJaWXyPnyFp2S8bl2Z_bvEeBtmZxaKeLAfXL1ld_Zycq5temc2E_--EVr_PxWH-Vgp9UyyyLS87yjrT17g Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: a9e42cc8e82e41e2a5a33ae922079bc8 Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:13:48.132269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: a9e42cc8e82e41e2a5a33ae922079bc8 Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-DeleteServersTestJSON-1367510814-project Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 3eb721f100f24930bafd056d29048561 Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-DeleteServersTestJSON-1367510814-project Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:48.133808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'server_id': 'eebb35f8-6e3a-46d0-94f9-04805ef7dd48'} Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:13:48.134600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:48.135975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:13:48.139050 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Returning 404 to user: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:13:48.140883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0fbf8b90-f5c1-42c2-bbea-79fff1d82e83 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064313 Sep 11 15:13:48.142681 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 84/156] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:13:48 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:13:48.326485 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:48.336167 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9fb69295-46f4-4cfa-9ff9-4170a6aad542 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.244798 Sep 11 15:13:48.349456 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 73/157] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:48 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:49.363599 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:49.364866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:49.374087 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:49.375524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:49.376771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:49.378650 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:49.379754 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:49.380689 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:49.437629 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:49.438456 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:49.460765 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:49.461608 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:49.462329 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:49.463686 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:49.464453 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:49.465193 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:49.494234 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] HTTP exception thrown: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Request method failure captured: Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 HTTP/1.1 Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfriMfdmuptlZVY2S9ypFDMQa2gK6EcWkWml1HkbMvMinzl_YKPGIG7GJOWhbOE0lmk04F6ANE0PCZeJ2FcKVyAHNv1VAJJaWXyPnyFp2S8bl2Z_bvEeBtmZxaKeLAfXL1ld_Zycq5temc2E_--EVr_PxWH-Vgp9UyyyLS87yjrT17g Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: a9e42cc8e82e41e2a5a33ae922079bc8 Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:13:49.497316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: a9e42cc8e82e41e2a5a33ae922079bc8 Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-DeleteServersTestJSON-1367510814-project Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 3eb721f100f24930bafd056d29048561 Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-DeleteServersTestJSON-1367510814-project Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.498435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'eebb35f8-6e3a-46d0-94f9-04805ef7dd48'} Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:13:49.499280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.500465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.501556 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Returning 404 to user: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:13:49.501556 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-031e69a3-4444-4cbb-9ff3-38f47dbd946a tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 404 len: 111 microversion: 2.1 time: 0.067305 Sep 11 15:13:49.501556 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 74/158] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:13:49 2022] DELETE /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:13:49.510263 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:49.510898 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] [instance: eebb35f8-6e3a-46d0-94f9-04805ef7dd48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:49.518315 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:49.518819 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:49.519251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:49.519991 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:49.520504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:49.520998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:49.544454 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] HTTP exception thrown: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Request method failure captured: Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 HTTP/1.1 Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfriMfdmuptlZVY2S9ypFDMQa2gK6EcWkWml1HkbMvMinzl_YKPGIG7GJOWhbOE0lmk04F6ANE0PCZeJ2FcKVyAHNv1VAJJaWXyPnyFp2S8bl2Z_bvEeBtmZxaKeLAfXL1ld_Zycq5temc2E_--EVr_PxWH-Vgp9UyyyLS87yjrT17g Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: a9e42cc8e82e41e2a5a33ae922079bc8 Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:13:49.546319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9e42cc8e82e41e2a5a33ae922079bc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: a9e42cc8e82e41e2a5a33ae922079bc8 Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-DeleteServersTestJSON-1367510814 Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-DeleteServersTestJSON-1367510814-project Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 3eb721f100f24930bafd056d29048561 Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-DeleteServersTestJSON-1367510814-project Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.548531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'eebb35f8-6e3a-46d0-94f9-04805ef7dd48'} Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:13:49.549820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. Sep 11 15:13:49.551839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:13:49.553810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] Returning 404 to user: Instance eebb35f8-6e3a-46d0-94f9-04805ef7dd48 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:13:49.553810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d85c85b8-af3f-4480-ab07-4001e1f2f788 tempest-DeleteServersTestJSON-1367510814 tempest-DeleteServersTestJSON-1367510814-project] 10.222.0.44 "GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48" status: 404 len: 111 microversion: 2.1 time: 0.042418 Sep 11 15:13:49.553810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 75/159] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:49 2022] GET /compute/v2.1/servers/eebb35f8-6e3a-46d0-94f9-04805ef7dd48 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:13:49.887112 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:49.901707 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-67af9001-1f18-4169-8c1b-23db3f0751d7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.543484 Sep 11 15:13:49.902626 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 85/160] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:49 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:50.950664 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:50.951698 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:50.963007 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:50.964959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:50.965652 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:50.966963 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:50.968075 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:50.968248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:51.404652 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:51.421940 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8c36ba39-33bd-4ab7-955d-4d296ead7093 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.480220 Sep 11 15:13:51.423930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 76/161] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:50 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:13:52.476411 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:52.481541 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:52.502028 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:52.503244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:52.506917 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:52.509725 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:52.510883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:52.512695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:52.852719 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:52.863065 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7bdecc11-e54e-4859-a112-acd178584a1b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.403491 Sep 11 15:13:52.865042 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 86/162] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:52 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:53.915544 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:53.917124 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:53.938567 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:53.939865 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:53.941063 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:53.942727 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:53.943854 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:53.944939 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:54.246309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:54.266537 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fe87f733-7422-4527-9085-5310ca4f5a05 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.361837 Sep 11 15:13:54.267752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 77/163] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:53 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:55.296239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:55.296851 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:55.318599 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:55.319434 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:55.320135 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:55.321325 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:55.321962 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:55.322535 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:55.583998 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:55.603748 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1d47ff1e-7107-4399-a46f-dd54592b51d1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.311871 Sep 11 15:13:55.604345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 87/164] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:55 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:56.634134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:56.636370 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:56.650595 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:56.651799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:56.652724 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:56.654139 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:56.654902 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:56.655927 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:56.937856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:56.952942 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8a89cec3-0700-4831-bf17-01e660afdc55 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.327956 Sep 11 15:13:56.954328 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 78/165] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:56 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:57.998421 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:57.999319 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:58.013264 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:58.014005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:58.014190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:58.014943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:58.015403 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:58.015816 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:58.245181 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:58.260641 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-66c417da-c356-4188-900f-4f530b33b9b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.267232 Sep 11 15:13:58.261461 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 88/166] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:57 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:13:59.290793 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:13:59.291553 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:13:59.302393 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:59.303140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:59.303881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:59.304646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:13:59.305169 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:13:59.305648 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:13:59.464047 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:13:59.479767 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fa8336a4-7661-42a7-8ed2-d5bcf37f7fdf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.192837 Sep 11 15:13:59.480881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 79/167] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:13:59 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:00.510633 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:00.511723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:00.539695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:00.540531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:00.541540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:00.542526 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:00.543305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:00.544021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:00.552782 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:00.769844 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:00.782327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-239eee22-2bab-4605-9ae1-551b6a8bc2d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1521 microversion: 2.1 time: 0.278621 Sep 11 15:14:00.783235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 89/168] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:00 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:01.821190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:01.825010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:01.837975 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:01.838977 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:01.839772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:01.841070 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:01.841990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:01.842747 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:02.070154 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:02.085737 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-decd8975-ea6e-489a-88ff-29192f8be666 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1501 microversion: 2.1 time: 0.269121 Sep 11 15:14:02.087065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 80/169] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:01 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:02.135938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:02.137053 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:02.148985 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:02.150199 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:02.150971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:02.152273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:02.153082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:02.153855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:02.394896 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:02.408667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fa6474b0-8998-4e3a-84ab-9f90b5d64a64 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1517 microversion: 2.1 time: 0.279629 Sep 11 15:14:02.418966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 90/170] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:02 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:04.193863 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:04.197661 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:04.202223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=42 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:04.214639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:04.215434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:04.216206 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:04.217591 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:04.218982 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:04.219798 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:04.269949 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lazy-loading 'flavor' on Instance uuid d870f595-3d29-47d7-b4b4-6d51343a4acf {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:14:04.482375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a5bc7c89-080f-4ea9-b3ec-182425682367 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf/action" status: 200 len: 32 microversion: 2.1 time: 0.295253 Sep 11 15:14:04.483017 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 81/171] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:14:04 2022] POST /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 11 15:14:04.494387 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:04.495489 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:04.503411 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:04.504109 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:04.504722 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:04.505853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:04.506326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:04.506810 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:04.697469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:04.715013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a1f86ec9-a44e-4077-9518-4c00baff5dcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.224873 Sep 11 15:14:04.715616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 91/172] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:04 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:05.747334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:05.748035 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:05.756032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:05.756523 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:05.756960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:05.757717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:05.758171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:05.758588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:05.934353 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:05.945788 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-da1df72e-0ae6-4df2-abb6-86e5003872f4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.202961 Sep 11 15:14:05.946856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 82/173] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:05 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:06.971115 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:06.971788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:06.974032 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:06.980351 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:06.980833 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:06.981286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:06.982009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:06.982457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:06.982862 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:07.146805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:07.156305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bef241bb-6306-4e59-b8ce-bd958b3011c1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.189030 Sep 11 15:14:07.157078 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 92/174] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:06 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:08.183979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:08.184984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:08.193440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:08.193986 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:08.194585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:08.195265 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:08.195799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:08.196700 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:08.386220 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:08.398383 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-02a1a9a8-bde5-4bed-8a27-28454896fc09 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.220173 Sep 11 15:14:08.399513 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 83/175] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:08 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:09.439988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:09.440897 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:09.449950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:09.450562 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:09.451241 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:09.452179 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:09.452720 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:09.453338 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:09.647612 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:09.658956 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-31103f5a-7785-4048-8564-89791d870d45 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.222907 Sep 11 15:14:09.662619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 93/176] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:09 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:10.686977 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:10.688542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:10.698398 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:10.699480 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:10.700333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:10.701875 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:10.702638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:10.703387 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:10.952026 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:10.955877 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:10.962445 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2bbb2a35-f301-4ac0-b607-fcf4ee1b1797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.279860 Sep 11 15:14:10.963022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 84/177] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:10 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:11.992691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:11.994995 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:12.008553 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:12.009837 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:12.010854 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:12.012680 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:12.013693 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:12.014551 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:12.230337 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:12.247957 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6700fc32-8b28-4e8a-83cc-6a8ba13d88db tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.263283 Sep 11 15:14:12.249324 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 94/178] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:11 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:13.283301 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:13.284081 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:13.293665 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:13.294203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:13.294692 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:13.295838 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:13.296561 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:13.297252 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:13.524961 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:13.537075 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d4430152-c667-43aa-a014-9e5bc9e251e2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.268997 Sep 11 15:14:13.537752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 85/179] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:13 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:14.577790 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:14.580133 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:14.591885 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:14.593004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:14.593854 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:14.595126 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:14.595976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:14.596775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:14.822248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:14.838027 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0ffdf282-fc00-467c-8848-46f9acafac77 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.277375 Sep 11 15:14:14.839164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 95/180] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:14 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:15.866669 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:15.868022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:15.888325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:15.889352 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:15.889952 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:15.891061 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:15.891616 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:15.892117 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:16.122454 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:16.143946 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-20fdd1f6-ba27-480e-8864-aa60ff8ec3f7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.282539 Sep 11 15:14:16.145311 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 86/181] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:15 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:17.183535 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:17.184381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:17.193968 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:17.194660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:17.195255 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:17.196212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:17.196734 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:17.197868 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:17.427788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:17.440224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c74df31d-9ad0-4177-bef8-7d2d0c0397d3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.261952 Sep 11 15:14:17.440830 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 96/182] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:17 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:18.213044 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a5aaf172-4957-4c18-9044-a72b0982e363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:18.214939 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a5aaf172-4957-4c18-9044-a72b0982e363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:18.226069 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5aaf172-4957-4c18-9044-a72b0982e363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:18.227028 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5aaf172-4957-4c18-9044-a72b0982e363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:18.227904 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5aaf172-4957-4c18-9044-a72b0982e363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:18.229213 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5aaf172-4957-4c18-9044-a72b0982e363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:18.230026 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5aaf172-4957-4c18-9044-a72b0982e363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:18.230827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5aaf172-4957-4c18-9044-a72b0982e363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:18.270165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a5aaf172-4957-4c18-9044-a72b0982e363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/ips" status: 200 len: 151 microversion: 2.20 time: 0.075110 Sep 11 15:14:18.271555 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 87/183] 10.222.0.44 () {60 vars in 1289 bytes} [Sun Sep 11 15:14:18 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/ips => generated 151 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:14:18.482488 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:18.483603 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:18.495679 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:18.496508 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:18.497270 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:18.498573 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:18.499617 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:18.500350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:18.553645 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-99e5d39a-18b3-43fc-9440-6a72f3f0ae84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:18.554404 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-99e5d39a-18b3-43fc-9440-6a72f3f0ae84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:18.565558 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99e5d39a-18b3-43fc-9440-6a72f3f0ae84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:18.566692 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99e5d39a-18b3-43fc-9440-6a72f3f0ae84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:18.567803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99e5d39a-18b3-43fc-9440-6a72f3f0ae84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:18.569336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99e5d39a-18b3-43fc-9440-6a72f3f0ae84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:18.570445 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99e5d39a-18b3-43fc-9440-6a72f3f0ae84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:18.571455 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99e5d39a-18b3-43fc-9440-6a72f3f0ae84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:18.661072 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-99e5d39a-18b3-43fc-9440-6a72f3f0ae84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/ips" status: 200 len: 150 microversion: 2.1 time: 0.114506 Sep 11 15:14:18.679089 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 88/184] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:14:18 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/ips => generated 150 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:14:18.868756 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:18.884005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-26242a4a-300b-4c8e-8c2f-553edcbad2e3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.408407 Sep 11 15:14:18.885119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 97/185] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:18 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:19.934836 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:19.937542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:19.955325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:19.957688 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:19.958474 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:19.959703 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:19.961218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:19.962545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:20.227271 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:20.244085 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9fc2385c-b5b9-4387-8c81-046203410a0e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.321202 Sep 11 15:14:20.245253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 89/186] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:19 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:21.270199 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:21.271181 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:21.278955 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:21.279348 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:21.280319 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:21.281118 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:21.281525 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:21.282242 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:21.476518 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:21.487470 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1d70520a-980a-4ada-8aa1-540962130952 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.222385 Sep 11 15:14:21.502230 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 98/187] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:21 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:22.514467 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:22.515371 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:22.524873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:22.525925 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:22.526858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:22.528269 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:22.529033 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:22.529784 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:22.638044 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-19853395-27f2-4dc8-b5d4-f798131e2e60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "714daf82-ca03-416e-8bbc-07028ba12ff9"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:22.641590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-19853395-27f2-4dc8-b5d4-f798131e2e60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:22.658333 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19853395-27f2-4dc8-b5d4-f798131e2e60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:22.659821 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19853395-27f2-4dc8-b5d4-f798131e2e60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:22.661013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19853395-27f2-4dc8-b5d4-f798131e2e60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:22.662727 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19853395-27f2-4dc8-b5d4-f798131e2e60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:22.664794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19853395-27f2-4dc8-b5d4-f798131e2e60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:22.666853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19853395-27f2-4dc8-b5d4-f798131e2e60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:22.862225 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:22.895695 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c795478f-e66d-450d-b807-d8fa7194629c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.386393 Sep 11 15:14:22.897347 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 90/188] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:22 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:23.230317 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-19853395-27f2-4dc8-b5d4-f798131e2e60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.597788 Sep 11 15:14:23.233722 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 99/189] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:14:22 2022] POST /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-volume_attachments => generated 194 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:14:23.934337 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:23.936243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:23.952381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:23.953065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:23.953859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:23.954995 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:23.955590 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:23.956509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:24.142180 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:24.143269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:24.160979 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:24.161973 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:24.162503 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:24.163922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:24.164591 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:24.165240 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:24.218157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lazy-loading 'flavor' on Instance uuid 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:14:24.519441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:24.534810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ff6f31d5-f33f-4762-98e3-95853ac22e81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.606148 Sep 11 15:14:24.536174 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 91/190] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:23 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:24.647230 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0838b07e-56d0-4b90-96a1-3eda4f08ecde tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/action" status: 202 len: 0 microversion: 2.20 time: 0.512806 Sep 11 15:14:24.647972 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 100/191] 10.222.0.44 () {62 vars in 1319 bytes} [Sun Sep 11 15:14:24 2022] POST /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 15:14:24.659714 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:24.660753 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:24.674503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:24.675289 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:24.675989 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:24.677351 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:24.677988 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:24.678570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:24.858696 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:24.869209 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:24.870692 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:24.871934 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-da06ed34-1086-4f85-a729-3fa1aedfc235 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.217181 Sep 11 15:14:24.872502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 92/192] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:24 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:14:25.586207 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:25.587016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:25.595223 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:25.595702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:25.596219 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:25.597167 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:25.597659 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:25.598144 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:25.793352 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:25.806901 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1cf20f88-3836-49f2-8f27-731f83a6ba4d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.226266 Sep 11 15:14:25.808121 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 101/193] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:25 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:25.904198 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:25.906206 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:25.919035 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:25.919889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:25.920849 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:25.922578 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:25.924303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:25.925381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:26.149563 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:26.159690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:26.161338 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:26.162549 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-30254593-f0fe-4acd-b22f-ca5a0eb8f9ff tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.267773 Sep 11 15:14:26.163120 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 93/194] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:25 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:26.848223 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:26.848918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:26.857071 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:26.857665 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:26.858205 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:26.859068 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:26.859586 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:26.860064 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:26.888020 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:27.044214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:27.055276 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b92b93f7-2795-4364-b816-e36aa494dee5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.213290 Sep 11 15:14:27.056497 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 102/195] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:26 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:27.207026 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:27.207643 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:27.215507 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:27.215993 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:27.216422 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:27.217128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:27.217608 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:27.218010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:27.378213 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:27.387418 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:27.388880 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:27.390141 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-23d95fbd-eff8-4b23-9eed-0a15aa629ff0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.187928 Sep 11 15:14:27.390736 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 94/196] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:27 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:28.093561 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:28.094615 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:28.103553 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:28.104304 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:28.104878 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:28.105969 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:28.106533 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:28.107202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:28.298299 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:28.308382 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-264969ae-2c03-444c-9089-6d9b8a514ae5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.218754 Sep 11 15:14:28.308382 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 103/197] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:28 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:28.417193 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:28.417995 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:28.425811 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:28.426468 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:28.426936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:28.427688 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:28.428279 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:28.428768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:28.606599 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:28.617821 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:28.619292 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:28.620510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ef5820c0-9ad1-4bf2-81b0-aacb9ed42e85 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.208001 Sep 11 15:14:28.621081 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 95/198] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:28 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:29.345560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:29.347589 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:29.359374 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:29.360474 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:29.361898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:29.363356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:29.365252 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:29.366216 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:29.603759 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:29.621728 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5f835770-3fc7-484f-b97c-3f006e6f61de tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.283505 Sep 11 15:14:29.624039 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 104/199] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:29 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:29.652288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:29.653545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:29.664446 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:29.665625 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:29.666344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:29.667817 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:29.668892 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:29.669629 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:29.885860 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:29.896966 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:29.898816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:29.900289 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7bd15bd5-362d-46e7-93df-4bb7670d8e57 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.255080 Sep 11 15:14:29.901301 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 96/200] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:29 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:30.649450 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:30.650352 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:30.660647 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:30.661704 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:30.662498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:30.663788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:30.664606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:30.665463 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:30.833742 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:30.843306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-16caabd0-f8bf-41b8-97e2-316a3f2a294b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.198593 Sep 11 15:14:30.843912 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 105/201] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:30 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:30.931424 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:30.932094 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:30.941909 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:30.942449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:30.942928 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:30.943755 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:30.944245 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:30.944701 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:31.128294 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:31.138885 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:31.140856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:31.142603 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3d8afeb2-bcfa-4a5a-9583-40c3b27f91e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.215323 Sep 11 15:14:31.143341 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 97/202] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:30 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:31.867703 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:31.868430 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:31.875887 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:31.876425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:31.876923 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:31.877851 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:31.878399 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:31.879013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:32.035944 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:32.045434 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-37500785-46cb-4aa7-9fde-f86da47384cf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.181820 Sep 11 15:14:32.046036 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 106/203] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:31 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:32.170240 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:32.170972 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:32.178503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:32.179040 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:32.179441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:32.180317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:32.180926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:32.181583 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:32.367171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:32.378197 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:32.380211 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:32.381569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e92f575d-df47-4d18-ac80-0db043364aeb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.215690 Sep 11 15:14:32.382237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 98/204] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:32 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:33.070021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:33.070729 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:33.079125 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:33.079712 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:33.080434 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:33.081322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:33.081941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:33.082601 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:33.240759 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:33.250316 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-689fefdc-e7da-45d5-989d-218301a655d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.184351 Sep 11 15:14:33.251345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 107/205] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:33 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:33.424315 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:33.425073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:33.432441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:33.432931 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:33.433410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:33.434177 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:33.435341 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:33.435834 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:33.605207 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:33.615030 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:33.616895 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:33.618259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-10f2539e-4d4a-4683-8773-bd835ae19343 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.197961 Sep 11 15:14:33.618820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 99/206] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:33 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:14:34.278381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:34.279277 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:34.288374 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:34.288893 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:34.289409 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:34.290167 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:34.290665 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:34.291119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:34.445732 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:34.460693 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-11eef2a7-9a64-4352-ac92-5b4a6ade9f67 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.188222 Sep 11 15:14:34.461682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 108/207] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:34 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:34.644814 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:34.645507 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:34.647976 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=38 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:34.654177 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:34.654679 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:34.655103 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:34.655808 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:34.656255 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:34.656671 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:34.979538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:34.988597 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:34.990060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:34.991434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8751ca4e-2e29-4ef0-9f2d-b1a6322e7142 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.351078 Sep 11 15:14:34.992023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 100/208] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:34 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:35.500260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:35.501164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:35.508190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:35.508677 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:35.509102 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:35.509852 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:35.510300 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:35.510715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:35.671723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:35.686063 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aba90eeb-04c7-4c4b-876b-291d87514da7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.189381 Sep 11 15:14:35.687118 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 109/209] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:35 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:36.017343 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:36.018174 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:36.025579 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:36.026078 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:36.026505 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:36.027203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:36.027644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:36.028041 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:36.186379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:36.195627 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:36.197452 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:36.198632 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-defe9159-85df-4d91-9f31-774cf321047b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.185301 Sep 11 15:14:36.199189 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 101/210] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:36 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:36.725380 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:36.726235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:36.733662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:36.734130 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:36.734562 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:36.735275 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:36.735709 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:36.736122 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:36.922639 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:36.931323 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d180c76b-903d-43f6-979a-53c458bb5a54 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.210528 Sep 11 15:14:36.931921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 110/211] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:36 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:37.224288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:37.224892 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:37.231994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:37.232534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:37.233006 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:37.233851 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:37.234374 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:37.234833 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:37.239855 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:37.390676 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:37.405868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:37.408856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:37.411514 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cb23ee4e-05b2-43e8-b1a4-257738854860 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.190864 Sep 11 15:14:37.412558 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 102/212] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:37 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:37.955515 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:37.956326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:37.958941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=38 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:37.964718 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:37.965232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:37.965666 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:37.966380 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:37.966830 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:37.967246 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:38.112517 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:38.122942 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-87de05fa-f259-4119-b511-8540bae850f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.171376 Sep 11 15:14:38.123679 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 111/213] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:37 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:38.440141 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:38.440719 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:38.448440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:38.448923 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:38.449381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:38.450082 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:38.450529 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:38.450940 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:38.648901 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:38.663068 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:38.663598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:38.665404 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6299e342-1a55-459f-9a95-5d40693e153a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.230442 Sep 11 15:14:38.667523 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 103/214] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:38 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:39.057473 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c2d224b7-8c46-4bb7-adc2-1dbd66e2e797 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: .version_select at 0x7f3938127e50>, body: {"keypair": {"name": "tempest-keypair-1268308747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3q7NRQ9R7oQrVENK4YMbcNX8FHMkiA0QWPnYnFl9X+zlqbFXxCMK0D8N4e6OE9tS5V9MA6GInlrnglM6bUjrVMHsjjcAGsWKKyLVYyBS7m1/m+KsQdf08+xiQms1XIoA=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:39.081557 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-c2d224b7-8c46-4bb7-adc2-1dbd66e2e797 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:14:39.086630 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-c2d224b7-8c46-4bb7-adc2-1dbd66e2e797 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for user c44105f2d90e469fb03f311a4cf1476f and project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:14:39.152763 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c2d224b7-8c46-4bb7-adc2-1dbd66e2e797 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098882 Sep 11 15:14:39.154562 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 112/215] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:14:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:14:39.167281 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:39.168681 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:39.179489 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:39.180622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:39.181786 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:39.183458 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:39.184879 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:39.185769 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:39.415730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:39.424782 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-919313f4-d2e8-4653-8e68-27ec532547a9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.266029 Sep 11 15:14:39.425847 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 104/216] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:39 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:39.708854 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:39.710060 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:39.720214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:39.721227 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:39.722039 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:39.723392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:39.724184 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:39.725161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:39.925930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:39.944145 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:39.946433 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:39.953049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d6554ef0-ba2d-41ab-86a4-421083ac39e4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.247698 Sep 11 15:14:39.953049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 113/217] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:39 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:14:40.463008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:40.464177 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:40.472147 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:40.472713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:40.473258 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:40.474008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:40.475185 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:40.475185 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:40.631616 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:40.646303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-baef846a-03d0-4967-aff1-d1d9f7f41976 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.187714 Sep 11 15:14:40.647407 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 105/218] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:40 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:40.975588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:40.976303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:40.983963 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:40.984641 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:40.985236 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:40.985991 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:40.986471 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:40.986953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:41.316741 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:41.327144 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:41.328657 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:41.329943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-96f78cc4-6fe8-4a5c-960c-b644e8d52850 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.358575 Sep 11 15:14:41.330531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 114/219] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:40 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:41.349699 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1333056961", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc5581c2-ebe9-4dd1-accb-09df241979bd"}], "security_groups": [{"name": "tempest-securitygroup--315269887"}], "key_name": "tempest-keypair-1268308747", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:41.486337 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] validate_networks() for [('fc5581c2-ebe9-4dd1-accb-09df241979bd', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:14:41.672853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:41.673760 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:41.682340 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:41.682927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:41.683359 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:41.684106 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:41.684588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:41.685009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:41.925888 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:41.940033 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-92daba82-4334-4bda-b552-78f6a60ea382 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.270903 Sep 11 15:14:41.941059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 115/220] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:41 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:42.051759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:14:42.052200 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:14:42.052696 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:14:42.053095 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:14:42.053577 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:14:42.063606 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:42.064085 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:42.064512 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:42.065292 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:42.065717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:42.066126 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:42.085277 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:14:42.089950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for user c44105f2d90e469fb03f311a4cf1476f and project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:14:42.102625 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:14:42.105013 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:14:42.156158 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0a459e78-3a81-47f4-9d96-803443991b23 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.814875 Sep 11 15:14:42.156810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 106/221] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:14:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:14:42.170962 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27fc7bfd-1346-4231-a6d8-7606d95197b2 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:42.172059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-27fc7bfd-1346-4231-a6d8-7606d95197b2 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:42.266950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-27fc7bfd-1346-4231-a6d8-7606d95197b2 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:42.279525 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-27fc7bfd-1346-4231-a6d8-7606d95197b2 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1242 microversion: 2.1 time: 0.114036 Sep 11 15:14:42.279959 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 116/222] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:42 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:42.359536 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:42.360417 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:42.370749 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:42.371459 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:42.372721 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:42.374728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:42.376042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:42.377033 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:42.638208 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:42.653105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:42.656153 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:42.658343 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3b983e62-5cc6-4a75-8b64-90ee90a61c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.305305 Sep 11 15:14:42.659640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 107/223] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:42 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:42.980403 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:42.981661 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:42.993074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:42.994139 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:42.994912 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:42.996147 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:42.997108 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:42.998013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.222849 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:43.238007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-232e9ad6-f6a4-45b1-85f9-717750ba6c31 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1503 microversion: 2.1 time: 0.262292 Sep 11 15:14:43.239095 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 117/224] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:42 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:43.283665 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8be821f9-e384-4cbd-8a87-a13d21e2719c"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:43.288005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:43.298541 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.299790 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.301030 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.302646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.303643 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.304340 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.330422 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:43.331594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:43.353633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] HTTP exception thrown: Cannot 'attach_volume' instance d870f595-3d29-47d7-b4b4-6d51343a4acf while it is in vm_state rescued Sep 11 15:14:43.356260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.357091 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.357851 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Request method failure captured: Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: POST /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf/os-volume_attachments HTTP/1.1 Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 74 Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrnpbJ4tYApu2HZiYVfH1ap7MKgo-OUf63y1EMdUS7c2C0Cyk0CXffOTT7TvUzCOKJeukeE8FSdqt1DqlhZSFyHN8iGlJfL7-w16CPok_KAr5O78YL_Ns6MtrmdddYXVleAKY6YUhYcUGweuANbGmFHEFc1dEIquEj-BU1TXuggVp0 Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:14:43.359264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7933806a47704d2d867be7312890b538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7933806a47704d2d867be7312890b538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 2bd47bf9aa4142b1b7ec8d02e8661578 Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {"volumeAttachment": {"volumeId": "8be821f9-e384-4cbd-8a87-a13d21e2719c"}} Sep 11 15:14:43.361883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Cannot 'attach_volume' instance d870f595-3d29-47d7-b4b4-6d51343a4acf while it is in vm_state rescued Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'server_id': 'd870f595-3d29-47d7-b4b4-6d51343a4acf', 'body': {'volumeAttachment': {'volumeId': '8be821f9-e384-4cbd-8a87-a13d21e2719c'}}} Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d870f595-3d29-47d7-b4b4-6d51343a4acf in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:14:43.363390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d870f595-3d29-47d7-b4b4-6d51343a4acf while it is in vm_state rescued Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:14:43.365936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:14:43.373979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:14:43.373979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:14:43.373979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d870f595-3d29-47d7-b4b4-6d51343a4acf while it is in vm_state rescued Sep 11 15:14:43.373979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:14:43.374715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.374715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.374715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.375244 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Returning 409 to user: Cannot 'attach_volume' instance d870f595-3d29-47d7-b4b4-6d51343a4acf while it is in vm_state rescued {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:14:43.375701 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3d1dc054-bc54-4416-aeba-7a64c8b78d73 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.096700 Sep 11 15:14:43.377443 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 108/225] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:14:43 2022] POST /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf/os-volume_attachments => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 11 15:14:43.406962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7b262910-bd21-40a2-abd1-4184dbe4bd10 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:43.409014 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7b262910-bd21-40a2-abd1-4184dbe4bd10 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:43.432122 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7b262910-bd21-40a2-abd1-4184dbe4bd10 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.432649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7b262910-bd21-40a2-abd1-4184dbe4bd10 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.448020 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7b262910-bd21-40a2-abd1-4184dbe4bd10 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.448020 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7b262910-bd21-40a2-abd1-4184dbe4bd10 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.450857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7b262910-bd21-40a2-abd1-4184dbe4bd10 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.451619 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7b262910-bd21-40a2-abd1-4184dbe4bd10 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.529350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:43.543641 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7ca45baf-88c0-4da1-963c-53fdd559cb07 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1238 microversion: 2.1 time: 0.222650 Sep 11 15:14:43.544558 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 118/226] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:43 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1238 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:43.572422 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7b262910-bd21-40a2-abd1-4184dbe4bd10 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf/action" status: 202 len: 0 microversion: 2.1 time: 0.186858 Sep 11 15:14:43.573105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 109/227] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:14:43 2022] POST /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:14:43.586372 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:43.587612 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:43.608488 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.609253 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.609965 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.610970 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.611733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.612409 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.697703 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:43.701007 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:43.716965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.717502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.717997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.718673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:43.719130 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:43.719556 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:43.959694 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:43.986322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a74abf57-78f9-4299-ab3a-cf0d2d283df4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1511 microversion: 2.1 time: 0.406562 Sep 11 15:14:43.991501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 119/228] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:43 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:44.016233 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:44.027242 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:44.028801 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:44.030310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f7b8f85d-bd56-49c0-b8b0-18cce2100a5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.346682 Sep 11 15:14:44.031262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 110/229] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:43 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:14:44.572748 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:44.574162 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:44.581899 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:44.582850 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:44.583529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:44.584475 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:44.585176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:44.585830 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:44.667748 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:44.712512 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4005769a-ea03-4e70-b02d-1697526d4510 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1302 microversion: 2.1 time: 0.143120 Sep 11 15:14:44.732598 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 120/230] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:44 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1302 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:45.027580 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:45.028481 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:45.037547 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:45.038380 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:45.039111 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:45.041666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:45.041666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:45.041666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:45.062718 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:45.064138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:45.079007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:45.080035 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:45.081030 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:45.082432 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:45.085330 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:45.088119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:45.104836 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:45.252236 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:45.271230 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ff8fb53a-ae87-4f5b-8e2f-7b99d23a1b9f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1511 microversion: 2.1 time: 0.249379 Sep 11 15:14:45.272047 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 111/231] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:45 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:45.347964 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:45.358341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:45.360414 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:45.361851 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9f1bb58d-03a3-4762-9c4e-eb2d3feb69e0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.304658 Sep 11 15:14:45.362420 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 121/232] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:45 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:14:45.742584 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:45.743384 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:45.756463 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:45.757320 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:45.757879 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:45.758767 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:45.759557 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:45.760356 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:45.944451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:45.954359 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0607c263-f9cb-4fd2-bb3d-a493ccf1dcd4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.216917 Sep 11 15:14:45.955045 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 112/233] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:45 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:46.323699 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:46.324860 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:46.337913 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:46.338870 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:46.341515 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:46.342867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:46.343736 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:46.344531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:46.395147 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:46.396137 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:46.408765 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:46.409989 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:46.410984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:46.413045 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:46.414040 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:46.414967 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:46.648570 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:46.664158 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bce284d4-654a-4c42-9be6-d52b6383b66d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1511 microversion: 2.1 time: 0.359384 Sep 11 15:14:46.665747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 122/234] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:46 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:46.689823 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:46.703690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:46.706275 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:46.708714 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f0a01645-7d6f-4113-ac27-87da86834b91 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.324816 Sep 11 15:14:46.709822 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 113/235] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:46 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:14:46.992315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:46.992944 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:47.000406 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:47.000982 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:47.001469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:47.002195 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:47.002663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:47.003091 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:47.155746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:47.165852 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2bd54712-45e8-4f9b-8240-2bf6fcde77b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.177394 Sep 11 15:14:47.166248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 123/236] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:46 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:47.711858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:47.712469 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:47.719226 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:47.719850 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:47.720399 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:47.721276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:47.721819 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:47.722326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:47.762872 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:47.763694 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:47.771247 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:47.771843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:47.772368 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:47.773161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:47.773898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:47.774453 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:47.973053 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:47.982635 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-51b37053-9abb-4c75-98f9-c0dabe45fc81 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1511 microversion: 2.1 time: 0.275909 Sep 11 15:14:47.983349 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 114/237] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:47 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:47.986913 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:47.997076 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:47.998574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:47.999786 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bffcd511-f27e-421b-b67f-9f4e7fb331b2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.241307 Sep 11 15:14:48.000367 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 124/238] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:47 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:48.192999 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:48.194106 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:48.205005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:48.205835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:48.206536 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:48.207685 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:48.208590 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:48.209323 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:48.380614 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:48.394578 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f1c77f48-96ea-4d24-a4b2-876922bf38dc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.208703 Sep 11 15:14:48.395806 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 115/239] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:48 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:49.006634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:49.007257 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:49.014215 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:49.014719 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:49.015157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:49.015876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:49.016327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:49.016749 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:49.030002 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:49.032446 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:49.049450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:49.050865 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:49.052871 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:49.054617 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:49.056306 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:49.057446 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:49.326826 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:49.343291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6ac6c794-097f-4702-b357-2eef18a0c469 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1511 microversion: 2.1 time: 0.340455 Sep 11 15:14:49.345297 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 125/240] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:49 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:49.376942 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:49.390002 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:49.391781 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:49.393345 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bff2d43e-94d2-4087-9bf0-e7479ec215b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.371216 Sep 11 15:14:49.394020 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 116/241] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:49 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:49.442271 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:49.443807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:49.457214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:49.457214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:49.458030 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:49.463698 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:49.464638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:49.465458 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:49.664447 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-e7629637-8815-45e1-ad3f-7a499240a415 req-b70966d2-857d-4413-93cb-ca59c08038bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35", "tag": "ae6aec31-6392-4cc4-856d-ec67402c382b"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:49.687210 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e7629637-8815-45e1-ad3f-7a499240a415 req-b70966d2-857d-4413-93cb-ca59c08038bd service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:49.688032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e7629637-8815-45e1-ad3f-7a499240a415 req-b70966d2-857d-4413-93cb-ca59c08038bd service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:49.688579 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e7629637-8815-45e1-ad3f-7a499240a415 req-b70966d2-857d-4413-93cb-ca59c08038bd service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:49.719796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:49.721063 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-e7629637-8815-45e1-ad3f-7a499240a415 req-b70966d2-857d-4413-93cb-ca59c08038bd service nova] Creating event network-changed:ae6aec31-6392-4cc4-856d-ec67402c382b for instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 on hv-cinder-83976 Sep 11 15:14:49.729039 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-e7629637-8815-45e1-ad3f-7a499240a415 req-b70966d2-857d-4413-93cb-ca59c08038bd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068201 Sep 11 15:14:49.730191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 117/242] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:14:49.740548 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d30beaa7-d1c6-4165-a478-23d78c2d5c64 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.308476 Sep 11 15:14:49.741629 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 126/243] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:49 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:50.372180 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:50.373026 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:50.381312 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:50.381810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:50.382257 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:50.383013 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:50.383466 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:50.383899 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:50.439483 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:50.440592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:50.454106 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:50.455180 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:50.455949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:50.457251 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:50.458302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:50.459072 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:50.609985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:50.621772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1b0e2715-ff9d-44af-a53d-f80dceeeb588 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1517 microversion: 2.1 time: 0.253796 Sep 11 15:14:50.622889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 118/244] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:50 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1517 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:50.648261 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:50.660886 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:50.665190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:50.666721 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-56279805-e2c7-4103-b29d-dc3e1ee85434 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1741 microversion: 2.20 time: 0.234216 Sep 11 15:14:50.667553 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 127/245] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:50 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:50.766815 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:50.767444 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:50.774797 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:50.775643 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:50.776372 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:50.777888 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:50.779310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:50.780105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:50.812633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:51.055415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:51.076804 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d7555f7a-d0fb-47da-a633-39efa9021343 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.313531 Sep 11 15:14:51.078715 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 119/246] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:50 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:51.706168 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:51.708570 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:51.720598 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:51.721630 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:51.722558 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:51.724124 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:51.725278 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:51.726300 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:51.924830 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:51.934419 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:51.935896 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:51.937242 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7c7eeee7-dec9-4d36-9db8-58537395dd8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1741 microversion: 2.20 time: 0.240463 Sep 11 15:14:51.937710 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 128/247] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:51 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1741 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:14:52.112322 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:52.113363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:52.115667 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:52.116374 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:52.123030 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:52.123538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:52.123998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:52.124714 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:52.125176 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:52.125635 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:52.278424 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4d4b752f-f46a-4a65-babf-a51ad3093d1a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'create', calling method: .version_select at 0x7f39381278b0>, body: {"keypair": {"name": "tempest-keypair-1952220402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwEcCZ/vSj5iNEbUa63rgfNsMA3yiyJDxV/xSqrQpwo2qZvQc4Nib5k3uNb3GuFWWPwblobXpeFqKuq8xCmo7wlg7LA76TMEffltYdJE4ij9UzzkBz03R1YAgBKa2W3lA=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:52.293493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:52.316820 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-4d4b752f-f46a-4a65-babf-a51ad3093d1a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Getting quotas for project 7933806a47704d2d867be7312890b538. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:14:52.322483 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-4d4b752f-f46a-4a65-babf-a51ad3093d1a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Getting quotas for user 2bd47bf9aa4142b1b7ec8d02e8661578 and project 7933806a47704d2d867be7312890b538. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:14:52.346164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:52.355262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4d4b752f-f46a-4a65-babf-a51ad3093d1a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087056 Sep 11 15:14:52.356957 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 129/248] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:14:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:14:52.364529 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-54bffaff-7f91-44f4-8852-618c07797fb7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.256037 Sep 11 15:14:52.365789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 120/249] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:52 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:52.966123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:52.966957 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:52.974198 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:52.974716 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:52.975471 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:52.976276 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:52.976850 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:52.977196 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:53.177466 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:53.188352 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:53.190092 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:53.191783 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6d69ca5b-d357-41fa-9ef8-319a658996b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1741 microversion: 2.20 time: 0.230432 Sep 11 15:14:53.192334 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 130/250] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:52 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:14:53.399925 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:53.400955 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:53.413253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:53.414258 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:53.415159 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:53.416380 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:53.416970 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:53.417518 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:53.671387 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:53.685390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b74ae8e6-142b-4af1-8681-e278182be989 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.298184 Sep 11 15:14:53.686577 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 121/251] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:53 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:54.229978 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:54.230756 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:54.242859 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:54.243858 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:54.244660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:54.246003 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:54.246851 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:54.247615 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:54.495725 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:54.507014 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:54.508623 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:54.510096 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f5108b3a-0d1b-4b65-8529-1a06f9d307cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1741 microversion: 2.20 time: 0.286972 Sep 11 15:14:54.510812 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 131/252] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:54 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1741 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:54.717527 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:54.718518 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:54.730019 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:54.730860 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:54.731630 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:54.732827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:54.733661 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:54.734546 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:54.812927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1044448612", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "999c434d-8caa-4d39-8414-62eace84bdc9"}], "security_groups": [{"name": "tempest-securitygroup--1146122704"}], "key_name": "tempest-keypair-1952220402", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:54.956928 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:54.965662 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-79494de2-c36d-496f-a023-8802a13e2a8d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.255585 Sep 11 15:14:54.966231 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 122/253] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:54 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:55.008342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] validate_networks() for [('999c434d-8caa-4d39-8414-62eace84bdc9', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:14:55.547902 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:55.559357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:55.570656 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:55.572535 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:55.572535 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:55.573228 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:55.574282 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:55.575517 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:55.604522 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:14:55.605551 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:14:55.607440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:14:55.608821 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:14:55.609592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:14:55.633096 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:55.634410 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:55.635447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:55.636662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:55.637756 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:55.638744 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:55.688371 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Getting quotas for project 7933806a47704d2d867be7312890b538. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:14:55.698217 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Getting quotas for user 2bd47bf9aa4142b1b7ec8d02e8661578 and project 7933806a47704d2d867be7312890b538. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:14:55.722867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:14:55.727694 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:14:55.757820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:55.776029 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:55.778371 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:55.779874 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ff566e86-2955-4e08-99d9-9a357d8514ad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1741 microversion: 2.20 time: 0.246497 Sep 11 15:14:55.781092 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 123/254] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:55 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:14:55.839649 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-95645da9-b069-4b07-ac38-fb10ebe4b9c7 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.030899 Sep 11 15:14:55.847854 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 132/255] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:14:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 15:14:55.849647 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-ac212ced-6c26-47b6-a1ad-a11d37b21bbb req-af0df567-a447-40bc-99fe-5fc16b80d4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8", "name": "network-vif-plugged", "status": "completed", "tag": "0ee60018-4df2-40cf-8323-5711c188966a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:14:55.867657 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ac212ced-6c26-47b6-a1ad-a11d37b21bbb req-af0df567-a447-40bc-99fe-5fc16b80d4d0 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:55.868847 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ac212ced-6c26-47b6-a1ad-a11d37b21bbb req-af0df567-a447-40bc-99fe-5fc16b80d4d0 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:55.870112 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ac212ced-6c26-47b6-a1ad-a11d37b21bbb req-af0df567-a447-40bc-99fe-5fc16b80d4d0 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:55.871364 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-836c28db-fe36-4426-b1c2-19a59010b33f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:55.872336 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-836c28db-fe36-4426-b1c2-19a59010b33f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:55.895236 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-ac212ced-6c26-47b6-a1ad-a11d37b21bbb req-af0df567-a447-40bc-99fe-5fc16b80d4d0 service nova] Creating event network-vif-plugged:0ee60018-4df2-40cf-8323-5711c188966a for instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 on hv-cinder-83976 Sep 11 15:14:55.942435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-ac212ced-6c26-47b6-a1ad-a11d37b21bbb req-af0df567-a447-40bc-99fe-5fc16b80d4d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098457 Sep 11 15:14:55.948962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 124/256] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:14:55.996459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-836c28db-fe36-4426-b1c2-19a59010b33f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:55.999196 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:56.000274 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:56.004580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-836c28db-fe36-4426-b1c2-19a59010b33f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1246 microversion: 2.1 time: 0.154660 Sep 11 15:14:56.005520 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 133/257] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:55 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1246 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:56.018365 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:56.019182 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:56.019926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:56.020728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:56.021479 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:56.022125 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:56.220559 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:56.230125 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8bf40e7d-d0c6-470d-95c9-19bf1fffad9d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.242950 Sep 11 15:14:56.230507 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 125/258] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:55 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:56.811176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:56.812265 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:56.828755 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:56.829621 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:56.842521 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:56.844812 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:56.846010 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:56.847441 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:57.051832 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:57.052477 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:57.061047 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:57.061697 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:57.062157 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:57.062891 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:57.063348 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:57.063915 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:57.212261 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:57.230696 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-895c0976-64fd-4b47-885b-f12480ad5e1e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1298 microversion: 2.1 time: 0.185647 Sep 11 15:14:57.232308 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 126/259] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:57 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1298 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:57.284702 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:57.291638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:57.301460 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:57.306060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:57.307567 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:57.308675 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:57.310434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:57.312004 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:57.313315 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:57.317447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:57.321772 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:57.324005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d7c0d7d4-b154-40ab-912b-707aa0184039 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.520392 Sep 11 15:14:57.333189 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 134/260] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:56 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:57.508663 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:57.517897 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-343883be-b3f0-42a3-aef4-899cb05ff1a8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.251119 Sep 11 15:14:57.518640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 127/261] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:57 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:58.275673 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:58.276995 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:58.288286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:58.288779 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:58.289253 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:58.289970 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:58.290421 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:58.290908 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:58.378250 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:58.380005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:58.394335 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:58.394966 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:58.395433 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:58.396183 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:58.399757 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:58.403210 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:58.455524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:58.475172 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-56597481-a497-4e1a-a041-07e02d804ee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1304 microversion: 2.1 time: 0.198762 Sep 11 15:14:58.498966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 135/262] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:58 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1304 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:58.561928 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:58.563107 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:58.574297 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:58.577606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:58.578326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:58.579833 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:58.583019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:58.583841 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:58.792780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:58.826878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:58.830981 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:58.834755 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0ccbcb8c-8be8-4dca-b130-2dbd874fd50f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.466993 Sep 11 15:14:58.840020 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 128/263] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:58 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:14:58.933278 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:58.946139 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f3c83627-3a39-40bf-b235-90d6161f70cb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.392332 Sep 11 15:14:58.947393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 136/264] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:58 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:14:59.503088 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:59.504807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:59.512903 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:59.513789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:59.514499 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:59.515498 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:59.516179 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:59.516805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:59.724987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:14:59.745368 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9e403594-2609-4bbe-ad76-ba0660b6db19 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.246218 Sep 11 15:14:59.746717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 129/265] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:59 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:14:59.866864 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:59.868305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:59.883702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:59.884254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:59.884696 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:59.885463 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:59.888900 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:59.888900 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:59.969998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:14:59.972075 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:14:59.985929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:59.986875 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:59.987621 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:14:59.988751 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:14:59.989523 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:14:59.990178 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:00.279795 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:00.299079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:00.300928 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:00.303214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:00.309614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1ed160bb-6488-4cc5-b748-5b1933e798f7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.446500 Sep 11 15:15:00.311600 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6f78c3d2-4a6f-41a0-bf75-507a9bc4aedb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.345508 Sep 11 15:15:00.312308 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 130/266] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:14:59 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:00.325181 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 137/267] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:14:59 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:00.338683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-8c661266-8f40-43d3-8d91-ca4ed4cb1e0e req-bce92210-f1c4-4130-aec1-ef1d7590872a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35", "name": "network-vif-plugged", "status": "completed", "tag": "ae6aec31-6392-4cc4-856d-ec67402c382b"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:00.353067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-8c661266-8f40-43d3-8d91-ca4ed4cb1e0e req-bce92210-f1c4-4130-aec1-ef1d7590872a service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:00.354120 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-8c661266-8f40-43d3-8d91-ca4ed4cb1e0e req-bce92210-f1c4-4130-aec1-ef1d7590872a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:00.355330 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-8c661266-8f40-43d3-8d91-ca4ed4cb1e0e req-bce92210-f1c4-4130-aec1-ef1d7590872a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:00.372403 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-8c661266-8f40-43d3-8d91-ca4ed4cb1e0e req-bce92210-f1c4-4130-aec1-ef1d7590872a service nova] Creating event network-vif-plugged:ae6aec31-6392-4cc4-856d-ec67402c382b for instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 on hv-cinder-83976 Sep 11 15:15:00.381902 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-8c661266-8f40-43d3-8d91-ca4ed4cb1e0e req-bce92210-f1c4-4130-aec1-ef1d7590872a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067190 Sep 11 15:15:00.382974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 131/268] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:15:00.774469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:00.775090 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:00.795079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:00.795592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:00.796036 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:00.796793 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:00.797508 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:00.798104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:01.025531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-696d5ac9-9d17-463a-a698-3573e5d6224d req-88578574-d26d-477d-8fe1-213f2455135b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae96dd1-992b-4b45-b780-95ee7a2a4d0f", "tag": "0d49c605-6c2c-4c31-80df-739077e3707e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:01.041583 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-696d5ac9-9d17-463a-a698-3573e5d6224d req-88578574-d26d-477d-8fe1-213f2455135b service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:01.042490 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-696d5ac9-9d17-463a-a698-3573e5d6224d req-88578574-d26d-477d-8fe1-213f2455135b service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:01.043249 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-696d5ac9-9d17-463a-a698-3573e5d6224d req-88578574-d26d-477d-8fe1-213f2455135b service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:01.059542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-696d5ac9-9d17-463a-a698-3573e5d6224d req-88578574-d26d-477d-8fe1-213f2455135b service nova] Creating event network-changed:0d49c605-6c2c-4c31-80df-739077e3707e for instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f on hv-cinder-83976 Sep 11 15:15:01.065699 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:01.066684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-696d5ac9-9d17-463a-a698-3573e5d6224d req-88578574-d26d-477d-8fe1-213f2455135b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045036 Sep 11 15:15:01.067406 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 132/269] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:15:01.083337 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-028c2801-b5fa-40cd-ab14-1ff20d5a7e5b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.312539 Sep 11 15:15:01.084481 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 138/270] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:00 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:01.346352 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:01.350225 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:01.350794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:01.351818 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:01.368864 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:01.372629 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:01.373938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:01.374954 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:01.375614 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:01.377125 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:01.377494 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:01.378197 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:01.379157 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:01.380070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:01.380837 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:01.381858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:01.792444 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:01.808456 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:01.810447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:01.812310 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3c576167-322e-4781-9530-f44ea0fdd6b5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.472058 Sep 11 15:15:01.826009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 139/271] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:01 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:01.892861 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:01.912958 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-07f88ef0-f64c-48a1-b278-ce3d6802f8ba tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1367 microversion: 2.1 time: 0.576779 Sep 11 15:15:01.914623 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 133/272] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:01 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1367 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:02.109822 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:02.110788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:02.124078 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:02.127086 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:02.127636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:02.128558 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:02.131408 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:02.131848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:02.170278 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:02.466076 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:02.492446 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-62c88ccb-9d22-4d63-bdac-86d8bdaee3d5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.386841 Sep 11 15:15:02.496398 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 140/273] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:02 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:02.844144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:02.845298 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:02.860382 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:02.862909 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:02.863921 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:02.865455 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:02.866607 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:02.867262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:02.949354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:02.950403 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:03.001311 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:03.011865 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:03.012665 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:03.021711 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:03.028570 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:03.036827 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:03.038628 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:03.318811 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:03.348983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:03.351568 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:03.353204 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9759eef8-4643-4d84-b70e-d86876c33c97 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.516298 Sep 11 15:15:03.359088 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 134/274] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:02 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:03.459245 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:03.469796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c01fa471-39c4-444f-98e3-64f747fc0fe8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1557 microversion: 2.1 time: 0.533289 Sep 11 15:15:03.470835 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 141/275] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:02 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1557 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:03.519112 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-588e0633-eb0f-4882-abe4-592e5f3f20e7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:03.520179 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-588e0633-eb0f-4882-abe4-592e5f3f20e7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:03.530881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-588e0633-eb0f-4882-abe4-592e5f3f20e7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:03.532004 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-588e0633-eb0f-4882-abe4-592e5f3f20e7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:03.536730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-588e0633-eb0f-4882-abe4-592e5f3f20e7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:03.543724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:03.547765 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:03.557585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-588e0633-eb0f-4882-abe4-592e5f3f20e7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:03.560052 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-588e0633-eb0f-4882-abe4-592e5f3f20e7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:03.561618 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-588e0633-eb0f-4882-abe4-592e5f3f20e7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:03.583444 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:03.589192 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:03.591175 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:03.597696 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:03.603385 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:03.608772 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:03.720869 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-588e0633-eb0f-4882-abe4-592e5f3f20e7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211964 Sep 11 15:15:03.722109 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 135/276] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 15:15:03 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:15:04.013946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:04.028965 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1df0f051-7411-4dbd-97fb-3c5b7bf276c2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.495598 Sep 11 15:15:04.029635 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 142/277] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:03 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:04.405426 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:04.406665 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:04.423600 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:04.424704 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:04.432154 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:04.435608 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:04.441808 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:04.443570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:04.938113 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:04.977259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:04.977259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:04.977259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1ddd892a-69fb-4c2a-8348-f45de1a74593 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.579012 Sep 11 15:15:04.977981 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 136/278] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:04 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:05.056926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:05.067895 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:05.099433 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:05.106591 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:05.107518 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:05.108870 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:05.109758 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:05.110511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:05.517324 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:05.538487 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b6262215-3a40-43e3-97d0-c88ec03ebca5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.489645 Sep 11 15:15:05.559243 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 143/279] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:05 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:06.008107 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:06.008778 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:06.020647 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:06.022379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:06.026082 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:06.026807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:06.027751 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:06.030208 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:06.030969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:06.057260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-4cfa6ede-1cb6-4fa0-a60b-2a327ccab011 req-40b06128-651d-48ab-858d-17c7629e3086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35", "tag": "ae6aec31-6392-4cc4-856d-ec67402c382b"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:06.079513 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:06.086208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=12 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:06.089524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4cfa6ede-1cb6-4fa0-a60b-2a327ccab011 req-40b06128-651d-48ab-858d-17c7629e3086 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:06.092653 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4cfa6ede-1cb6-4fa0-a60b-2a327ccab011 req-40b06128-651d-48ab-858d-17c7629e3086 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:06.093596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4cfa6ede-1cb6-4fa0-a60b-2a327ccab011 req-40b06128-651d-48ab-858d-17c7629e3086 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:06.125364 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-4cfa6ede-1cb6-4fa0-a60b-2a327ccab011 req-40b06128-651d-48ab-858d-17c7629e3086 service nova] Creating event network-changed:ae6aec31-6392-4cc4-856d-ec67402c382b for instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 on hv-cinder-83976 Sep 11 15:15:06.131881 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-4cfa6ede-1cb6-4fa0-a60b-2a327ccab011 req-40b06128-651d-48ab-858d-17c7629e3086 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078432 Sep 11 15:15:06.133385 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 144/280] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:15:06.398873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:06.420694 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:06.422594 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:06.423959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-50a088ca-d741-47d6-8f25-12f5f6e37c59 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.421778 Sep 11 15:15:06.425784 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 137/281] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:06 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:06.568936 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:06.569947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:06.583450 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:06.583936 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:06.587230 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:06.588268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:06.588897 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:06.589636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:06.881298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:06.895416 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2c67561e-81b1-4ad1-93c2-508fb7444edd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.330813 Sep 11 15:15:06.899760 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 145/282] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:06 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:15:07.473561 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:07.474265 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:07.492445 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:07.493780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:07.496430 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:07.498086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:07.499499 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:07.500234 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:07.559770 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:07.747037 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:07.757059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:07.758903 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:07.760325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a7983913-ec11-4c03-96fd-ec31b311fd04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.293509 Sep 11 15:15:07.779288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 138/283] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:07 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:07.923411 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:07.924273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:07.938355 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:07.939075 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:07.940794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:07.941991 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:07.942594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:07.943127 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:08.196525 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:08.211541 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4e15d8f6-b7e7-444b-b6f2-3fb1419de9d0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.292027 Sep 11 15:15:08.212766 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 146/284] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:07 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:08.797204 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:08.798037 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:08.812853 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:08.814160 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:08.814803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:08.816716 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:08.817358 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:08.817924 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:09.056624 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:09.066746 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:09.068291 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:09.069676 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-528707ac-64d6-4f8c-a44a-f6d35b60b283 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.282710 Sep 11 15:15:09.085164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 139/285] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:08 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:09.261622 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:09.262457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:09.282912 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:09.287387 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:09.288662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:09.290081 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:09.290936 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:09.291702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:09.549101 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:09.559737 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-58bf7808-911c-49e8-95d6-065e931567d9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.303087 Sep 11 15:15:09.561204 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 147/286] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:09 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:09.962360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-0a974fe0-419a-4593-88b1-550182c86586 req-8312786a-d249-4e7c-a646-f6cb199a0313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae96dd1-992b-4b45-b780-95ee7a2a4d0f", "name": "network-vif-plugged", "status": "completed", "tag": "0d49c605-6c2c-4c31-80df-739077e3707e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:09.991908 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0a974fe0-419a-4593-88b1-550182c86586 req-8312786a-d249-4e7c-a646-f6cb199a0313 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:09.992569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0a974fe0-419a-4593-88b1-550182c86586 req-8312786a-d249-4e7c-a646-f6cb199a0313 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:09.993073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0a974fe0-419a-4593-88b1-550182c86586 req-8312786a-d249-4e7c-a646-f6cb199a0313 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:10.034679 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-0a974fe0-419a-4593-88b1-550182c86586 req-8312786a-d249-4e7c-a646-f6cb199a0313 service nova] Creating event network-vif-plugged:0d49c605-6c2c-4c31-80df-739077e3707e for instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f on hv-cinder-83976 Sep 11 15:15:10.053941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-0a974fe0-419a-4593-88b1-550182c86586 req-8312786a-d249-4e7c-a646-f6cb199a0313 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094932 Sep 11 15:15:10.055325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 140/287] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:15:10.104869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:10.113448 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:10.138931 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:10.138931 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:10.141240 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:10.142771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:10.143755 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:10.144586 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:10.415883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:10.436320 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:10.439713 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:10.442089 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ca76fc06-b465-4f59-ae35-6ccd3e9c9138 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.348177 Sep 11 15:15:10.443476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 148/288] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:10 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:10.589084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:10.590056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:10.597097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:10.597780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:10.598497 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:10.599429 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:10.599887 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:10.600297 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:10.834097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:10.847482 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-61fe89d6-a348-44a7-a6c8-7daafb70e4ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.263039 Sep 11 15:15:10.850216 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 141/289] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:10 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:15:11.482217 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:11.483560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:11.494029 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:11.494553 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:11.495526 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:11.496496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:11.497189 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:11.498060 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:11.778939 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:11.800364 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:11.803866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:11.806315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aa964347-ee44-400f-ae90-91cb16d7f38f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.329196 Sep 11 15:15:11.808181 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 149/290] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:11 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:11.880292 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:11.881241 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:11.900462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:11.903525 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:11.904902 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:11.906834 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:11.907825 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:11.909362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:12.165889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:12.177044 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-eec90720-119a-4202-96c9-60070acc86d8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1372 microversion: 2.1 time: 0.301910 Sep 11 15:15:12.178344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 142/291] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:11 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1372 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:12.837781 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:12.839499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:12.852762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:12.853396 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:12.854151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:12.854906 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:12.855366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:12.856051 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:13.084715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:13.103291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:13.107522 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:13.110287 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fb6281c9-05b5-428e-b849-87abdc42fa9a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1736 microversion: 2.20 time: 0.277215 Sep 11 15:15:13.111590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 150/292] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:12 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:13.216197 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:13.216819 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:13.226059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:13.226678 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:13.227190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:13.227972 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:13.228738 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:13.229238 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:13.594986 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:13.606044 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ef42d5f2-69c5-4f33-a20c-1f4792bb0aa1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1567 microversion: 2.1 time: 0.393844 Sep 11 15:15:13.606653 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 143/293] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:13 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1567 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:13.637557 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9c29905c-cf51-48db-96e3-0e701bd1cd92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:13.640009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9c29905c-cf51-48db-96e3-0e701bd1cd92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:13.652398 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c29905c-cf51-48db-96e3-0e701bd1cd92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:13.653375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c29905c-cf51-48db-96e3-0e701bd1cd92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:13.654446 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c29905c-cf51-48db-96e3-0e701bd1cd92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:13.655988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c29905c-cf51-48db-96e3-0e701bd1cd92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:13.656989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c29905c-cf51-48db-96e3-0e701bd1cd92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:13.657950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c29905c-cf51-48db-96e3-0e701bd1cd92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:13.951032 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9c29905c-cf51-48db-96e3-0e701bd1cd92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.322645 Sep 11 15:15:13.952105 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 151/294] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 15:15:13 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-interface => generated 285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:15:14.138587 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:14.139266 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:14.148125 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:14.149022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:14.149774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:14.150693 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:14.151103 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:14.151851 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:14.925988 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:14.959024 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:14.987703 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:14.990144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-78bd52fe-0037-471f-830d-6119d9f35028 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1718 microversion: 2.20 time: 0.856246 Sep 11 15:15:15.004430 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 144/295] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:14 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1718 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:15.999004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-057ef8ec-d873-4c51-8a39-65e203c4fc3f req-0ececb69-ac7a-45a3-9ad0-8a2836c6d776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8", "name": "network-vif-unplugged", "status": "completed", "tag": "0ee60018-4df2-40cf-8323-5711c188966a"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:16.025306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-057ef8ec-d873-4c51-8a39-65e203c4fc3f req-0ececb69-ac7a-45a3-9ad0-8a2836c6d776 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:16.026341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-057ef8ec-d873-4c51-8a39-65e203c4fc3f req-0ececb69-ac7a-45a3-9ad0-8a2836c6d776 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:16.027857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:16.030188 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-057ef8ec-d873-4c51-8a39-65e203c4fc3f req-0ececb69-ac7a-45a3-9ad0-8a2836c6d776 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:16.037212 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:16.052767 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:16.057988 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:16.059290 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:16.060752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:16.064825 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:16.067204 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:16.102448 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-057ef8ec-d873-4c51-8a39-65e203c4fc3f req-0ececb69-ac7a-45a3-9ad0-8a2836c6d776 service nova] Creating event network-vif-unplugged:0ee60018-4df2-40cf-8323-5711c188966a for instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 on hv-cinder-83976 Sep 11 15:15:16.130500 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-057ef8ec-d873-4c51-8a39-65e203c4fc3f req-0ececb69-ac7a-45a3-9ad0-8a2836c6d776 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139991 Sep 11 15:15:16.134950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 152/296] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:15:16.560244 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:16.573799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:16.576213 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:16.577845 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-0fbe64a9-5517-4708-b451-353cf6526e4d req-be803362-3f46-493d-96e4-8bda0f65ee08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae96dd1-992b-4b45-b780-95ee7a2a4d0f", "tag": "0d49c605-6c2c-4c31-80df-739077e3707e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:16.578265 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-911ae005-c08c-4cbf-9212-621a4849dafd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1721 microversion: 2.20 time: 0.558793 Sep 11 15:15:16.579742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 145/297] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:16 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1721 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:16.595264 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0fbe64a9-5517-4708-b451-353cf6526e4d req-be803362-3f46-493d-96e4-8bda0f65ee08 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:16.596219 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0fbe64a9-5517-4708-b451-353cf6526e4d req-be803362-3f46-493d-96e4-8bda0f65ee08 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:16.597058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0fbe64a9-5517-4708-b451-353cf6526e4d req-be803362-3f46-493d-96e4-8bda0f65ee08 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:16.605402 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a63686d-1214-40e8-bb81-1acc52a8e32c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be3a4c6a-e20e-4ca6-970a-fb019dd32cad"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:16.608465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1a63686d-1214-40e8-bb81-1acc52a8e32c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:16.615813 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a63686d-1214-40e8-bb81-1acc52a8e32c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:16.616659 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a63686d-1214-40e8-bb81-1acc52a8e32c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:16.617292 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a63686d-1214-40e8-bb81-1acc52a8e32c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:16.618875 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a63686d-1214-40e8-bb81-1acc52a8e32c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:16.619597 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a63686d-1214-40e8-bb81-1acc52a8e32c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:16.620183 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a63686d-1214-40e8-bb81-1acc52a8e32c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:16.623200 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-0fbe64a9-5517-4708-b451-353cf6526e4d req-be803362-3f46-493d-96e4-8bda0f65ee08 service nova] Creating event network-changed:0d49c605-6c2c-4c31-80df-739077e3707e for instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f on hv-cinder-83976 Sep 11 15:15:16.632441 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-0fbe64a9-5517-4708-b451-353cf6526e4d req-be803362-3f46-493d-96e4-8bda0f65ee08 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059258 Sep 11 15:15:16.633644 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 153/298] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:15:17.138973 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1910198898", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "networks": [{"uuid": "027902dc-3f28-4764-a469-9d558d48f138"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:17.280174 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] validate_networks() for [('027902dc-3f28-4764-a469-9d558d48f138', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:15:17.345188 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1a63686d-1214-40e8-bb81-1acc52a8e32c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.743801 Sep 11 15:15:17.351850 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 146/299] 10.222.0.44 () {62 vars in 1364 bytes} [Sun Sep 11 15:15:16 2022] POST /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments => generated 188 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 15:15:17.617595 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:17.618611 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:17.625586 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:17.626438 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:17.627060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:17.628273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:17.628961 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:17.629814 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:17.694446 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120739) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 15:15:17.825361 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-02579cee-94a4-4604-97d0-ca974437ad69 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/action" status: 202 len: 0 microversion: 2.20 time: 0.211400 Sep 11 15:15:17.826580 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 147/300] 10.222.0.44 () {62 vars in 1319 bytes} [Sun Sep 11 15:15:17 2022] POST /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:15:17.846779 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:17.847402 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:17.864292 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:17.866365 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:17.867204 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:17.869254 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:17.870217 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:17.871125 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:18.135073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:18.150065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:18.151761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:18.153234 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-eac287ca-0ff4-4e65-81f7-c7e235d9a0be tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1747 microversion: 2.20 time: 0.314734 Sep 11 15:15:18.165170 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 148/301] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:17 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1747 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:18.165417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:15:18.165417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:15:18.165417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:15:18.165417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:15:18.165417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:15:18.181708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:18.182571 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:18.183344 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:18.184849 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:18.185574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:18.186370 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:18.223055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Getting quotas for project fd7984f5434f42098fb127572b6d1e0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:15:18.232340 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Getting quotas for user 0292da3873ef419097717fd11337a128 and project fd7984f5434f42098fb127572b6d1e0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:15:18.261285 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:15:18.266213 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:15:18.346164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-27beee4b-71c8-4d56-b018-111ae1483f6d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216683 Sep 11 15:15:18.365501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 154/302] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:15:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:15:18.370564 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e12b9c23-a641-4ae5-ada0-60f56c875a5a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:18.373114 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e12b9c23-a641-4ae5-ada0-60f56c875a5a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:18.485395 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e12b9c23-a641-4ae5-ada0-60f56c875a5a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:18.497407 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e12b9c23-a641-4ae5-ada0-60f56c875a5a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1219 microversion: 2.1 time: 0.136473 Sep 11 15:15:18.503824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 149/303] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:18 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:19.184678 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:19.185377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:19.197061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:19.197904 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:19.198505 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:19.199429 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:19.199880 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:19.200478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:19.469616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:19.492254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:19.495868 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:19.498787 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c1df000b-6644-421a-81a2-8780844a6741 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1747 microversion: 2.20 time: 0.318547 Sep 11 15:15:19.500669 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 155/304] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:19 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1747 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:19.536120 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:19.536766 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:19.543806 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:19.544301 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:19.544797 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:19.545700 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:19.546297 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:19.546725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:19.668472 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:19.683813 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9a147d59-251f-4992-8ac6-34022b63c85f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1271 microversion: 2.1 time: 0.151056 Sep 11 15:15:19.685242 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 150/305] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:19 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:20.529273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:20.531012 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:20.546682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:20.548139 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:20.550066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:20.551410 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:20.553571 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:20.554285 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:20.712736 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:20.714582 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:20.722224 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:20.722799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:20.723486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:20.724788 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:20.725697 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:20.726165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:20.847033 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:20.857488 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-85c9554c-d462-41c1-ab89-8a3107051fc8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1277 microversion: 2.1 time: 0.148419 Sep 11 15:15:20.858123 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 151/306] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:20 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:20.964856 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:20.985373 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:20.988767 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:20.992576 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5e886054-a12c-499f-8597-379db2071077 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1749 microversion: 2.20 time: 0.466995 Sep 11 15:15:20.994653 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 156/307] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:20 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1749 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:21.888538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:21.889413 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:21.897343 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:21.897823 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:21.898425 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:21.899289 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:21.899873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:21.900441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:22.023036 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:22.023747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:22.031843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:22.032437 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:22.032969 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:22.034364 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:22.034549 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:22.035099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:22.078462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:22.092388 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-76d70660-1ab2-4cc2-a6ed-8ed5dec8c2f3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.209167 Sep 11 15:15:22.101799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 152/308] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:21 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:22.236381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:22.246357 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:22.248506 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:22.250089 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f865e5e9-845b-49ce-8711-d9b84d87d00c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.231180 Sep 11 15:15:22.250589 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 157/309] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:22 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:22.453390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-015ac5d8-8fc4-4ff8-ab20-b598cff86687 req-9355a496-1cd2-40a9-a3e4-515ebab5b56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d94e54a-a4f8-46af-b908-554e5a7e2977", "tag": "8b5f6c9a-31cc-4ab9-b171-9313a5f7c315"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:22.471530 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-015ac5d8-8fc4-4ff8-ab20-b598cff86687 req-9355a496-1cd2-40a9-a3e4-515ebab5b56c service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:22.472412 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-015ac5d8-8fc4-4ff8-ab20-b598cff86687 req-9355a496-1cd2-40a9-a3e4-515ebab5b56c service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:22.472996 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-015ac5d8-8fc4-4ff8-ab20-b598cff86687 req-9355a496-1cd2-40a9-a3e4-515ebab5b56c service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:22.496676 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:22.499833 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-015ac5d8-8fc4-4ff8-ab20-b598cff86687 req-9355a496-1cd2-40a9-a3e4-515ebab5b56c service nova] Creating event network-changed:8b5f6c9a-31cc-4ab9-b171-9313a5f7c315 for instance 2d94e54a-a4f8-46af-b908-554e5a7e2977 on hv-cinder-83976 Sep 11 15:15:22.508453 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-015ac5d8-8fc4-4ff8-ab20-b598cff86687 req-9355a496-1cd2-40a9-a3e4-515ebab5b56c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060587 Sep 11 15:15:22.509029 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 153/310] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:15:23.124245 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:23.125509 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:23.134662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:23.135600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:23.136369 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:23.138023 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:23.139285 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:23.140778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:23.284038 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:23.285383 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:23.299898 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:23.300771 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:23.301599 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:23.302873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:23.303692 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:23.304432 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:23.431593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:23.441625 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3a54e957-5782-49b2-b43a-5da2abb50ff8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.326074 Sep 11 15:15:23.442324 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 158/311] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:23 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:23.544475 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:23.554845 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:23.556834 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:23.558183 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bd4ce674-35cc-4f28-8f0a-bd9fea864b40 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.285110 Sep 11 15:15:23.558832 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 154/312] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:23 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:24.486046 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:24.486967 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:24.495262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:24.496614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:24.497523 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:24.498515 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:24.499445 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:24.500135 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:24.586954 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:24.587628 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:24.595470 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:24.596389 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:24.618578 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:24.621899 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:24.623344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:24.626072 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:24.902284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:24.913880 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8cddda94-3c55-40bb-aa6c-da8c5301ace9 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.431969 Sep 11 15:15:24.920034 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 159/313] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:24 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:24.958299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:24.972961 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:24.974417 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:24.975732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-08b69ab1-60be-411e-b374-defa309dc48c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.393558 Sep 11 15:15:24.977823 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 155/314] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:24 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:25.961297 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:25.963538 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:25.978644 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:25.979942 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:25.980710 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:25.982039 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:25.982857 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:25.983626 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:25.993891 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:26.026050 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:26.026992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:26.043033 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:26.044863 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:26.047492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:26.051647 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:26.052251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:26.052694 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:26.237173 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:26.256601 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-35fb3be1-4e39-421e-83e8-c6167b2871c5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.310071 Sep 11 15:15:26.257548 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 160/315] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:25 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:15:26.399305 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:26.424228 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:26.426459 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:26.427957 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a180d5de-2af0-41b3-8cf8-b92e18655012 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.408383 Sep 11 15:15:26.429065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 156/316] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:26 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:27.366730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:27.367839 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:27.379424 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:27.380491 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:27.381056 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:27.382444 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:27.383580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:27.384153 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:27.472799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:27.473814 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:27.492711 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:27.493693 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:27.494525 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:27.495218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:27.495892 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:27.496503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:27.691913 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:27.708004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-169864f9-449e-464b-aa90-6fa3c9d78ea3 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.348955 Sep 11 15:15:27.717881 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 161/317] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:27 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:27.782023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:27.791996 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:27.793515 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:27.800440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8a39cc15-4116-421b-a541-2e9a3d2ab3ca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.331572 Sep 11 15:15:27.824503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 157/318] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:27 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:28.067188 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-e6d5a4b2-a51e-49d4-91dd-603d029896f7 req-ed71ef81-989f-4a61-b1c9-4d8c83c9e867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d94e54a-a4f8-46af-b908-554e5a7e2977", "name": "network-vif-plugged", "status": "completed", "tag": "8b5f6c9a-31cc-4ab9-b171-9313a5f7c315"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:28.085796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e6d5a4b2-a51e-49d4-91dd-603d029896f7 req-ed71ef81-989f-4a61-b1c9-4d8c83c9e867 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:28.087475 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e6d5a4b2-a51e-49d4-91dd-603d029896f7 req-ed71ef81-989f-4a61-b1c9-4d8c83c9e867 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:28.088531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e6d5a4b2-a51e-49d4-91dd-603d029896f7 req-ed71ef81-989f-4a61-b1c9-4d8c83c9e867 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:28.115270 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-e6d5a4b2-a51e-49d4-91dd-603d029896f7 req-ed71ef81-989f-4a61-b1c9-4d8c83c9e867 service nova] Creating event network-vif-plugged:8b5f6c9a-31cc-4ab9-b171-9313a5f7c315 for instance 2d94e54a-a4f8-46af-b908-554e5a7e2977 on hv-cinder-83976 Sep 11 15:15:28.123977 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-e6d5a4b2-a51e-49d4-91dd-603d029896f7 req-ed71ef81-989f-4a61-b1c9-4d8c83c9e867 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066180 Sep 11 15:15:28.124751 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 162/319] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:15:28.733106 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:28.733761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:28.736322 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:28.743235 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:28.743758 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:28.744190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:28.744938 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:28.745389 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:28.745812 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:28.830099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:28.831633 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:28.837070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:28.838155 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:28.845414 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:28.845905 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:28.846371 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:28.847291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:28.847898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:28.848311 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:28.958900 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:28.989419 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e836ba60-fdef-41b6-9457-8ff11981e4ac tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.259870 Sep 11 15:15:28.990652 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 158/320] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:28 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:29.113339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:29.130499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:29.133128 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:29.135362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e81137ed-b341-452b-995e-7f40412a2c02 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.305951 Sep 11 15:15:29.136399 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 163/321] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:28 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:30.034785 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:30.036530 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:30.045273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:30.045890 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:30.046336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:30.047093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:30.047563 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:30.047994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:30.177841 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:30.179375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:30.188704 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:30.189648 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:30.190885 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:30.192068 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:30.192712 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:30.193695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:30.573437 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:30.583357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9dcc2a0e-8b7c-4e10-8e32-132ca0c67186 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.553382 Sep 11 15:15:30.602707 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 159/322] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:30 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:30.657899 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:30.676527 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:30.679814 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:30.682183 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-17567556-505e-4854-953a-3510b406b1a1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.508416 Sep 11 15:15:30.683654 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 164/323] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:30 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:31.611827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:31.612783 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:31.622191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:31.622751 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:31.623466 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:31.624366 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:31.625108 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:31.626044 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:31.711058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:31.712475 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:31.720310 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:31.721234 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:31.721891 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:31.722822 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:31.723480 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:31.724102 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:31.881994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:31.892941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e30952b5-fd09-466b-b8c4-a8ee1516a0e0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.285642 Sep 11 15:15:31.911084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 160/324] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:31 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:31.956234 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:31.974563 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:31.977491 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:31.979745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e1ef9cf3-30da-4816-bcef-088480036e8e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.272630 Sep 11 15:15:31.981596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 165/325] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:31 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:32.918445 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:32.919376 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:32.926416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:32.926978 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:32.927553 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:32.928149 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:32.932474 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:32.933032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:33.007143 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:33.008103 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:33.016605 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:33.017540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:33.018347 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:33.019351 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:33.020142 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:33.020757 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:33.222079 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:33.231091 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a5f35750-6411-4108-8e36-c1dc0eae5019 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.316859 Sep 11 15:15:33.258490 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 161/326] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:32 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:15:33.319346 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:33.330177 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:33.331689 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:33.333173 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b23c7ac8-43bc-455d-b130-9fa50c35a986 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.330684 Sep 11 15:15:33.333766 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 166/327] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:33 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:34.256238 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:34.257262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:34.263693 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:34.264453 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:34.264607 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:34.265436 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:34.265807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:34.266225 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:34.362345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:34.363330 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:34.369929 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:34.371567 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:34.372266 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:34.372691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:34.373404 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:34.373847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:34.374255 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:34.465861 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:34.474177 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3c13a795-3763-40b6-b8db-ecf18f84e208 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.221895 Sep 11 15:15:34.474776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 162/328] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:34 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:34.553654 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:34.563240 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:34.564836 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:34.566147 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-68892492-f9e0-4a57-9aac-9f55241bcbb6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.208448 Sep 11 15:15:34.566715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 167/329] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:34 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:35.505639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:35.505639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:35.517996 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:35.519198 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:35.519747 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:35.521045 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:35.521819 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:35.522774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:35.596974 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:35.602453 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:35.629385 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:35.630103 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:35.630988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:35.631989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:35.632772 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:35.633508 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:35.784269 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:35.794415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d784361a-ae74-444e-96bd-f488de96b11b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.298656 Sep 11 15:15:35.795688 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 163/330] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:35 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:15:35.873920 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:35.883661 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:35.885126 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:35.886362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9da5f207-74d7-41ff-977b-ee7f32805475 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.297049 Sep 11 15:15:35.886941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 168/331] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:35 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:36.818688 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:36.819578 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:36.822274 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:36.828913 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:36.829440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:36.829883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:36.830595 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:36.831062 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:36.831479 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:36.921412 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:36.921412 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:36.925177 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:36.925808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:36.926306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:36.927107 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:36.927593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:36.928019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:37.123138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:37.137506 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-868c91c5-929e-4bba-8e3d-0589a5c2b008 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1319 microversion: 2.1 time: 0.323107 Sep 11 15:15:37.138447 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 164/332] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:36 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:37.153004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:37.163308 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:37.164748 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:37.165989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-83577e13-6d62-4194-8ff1-58c371431f67 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.253885 Sep 11 15:15:37.166554 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 169/333] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:36 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:38.168579 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:38.169626 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:38.182697 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:38.183745 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:38.184683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:38.186107 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:38.186824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:38.187338 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:38.210164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:38.211853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:38.226748 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:38.228529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:38.229361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:38.230436 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:38.231136 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:38.232225 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:38.490227 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:38.500522 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a3929037-f156-4697-9e9e-870eda7f156c tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1508 microversion: 2.1 time: 0.339884 Sep 11 15:15:38.501248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 165/334] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:38 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1508 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:38.566712 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:38.584580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:38.587868 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:38.590400 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e047196d-fb24-4700-a667-f63a92853cf5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.389370 Sep 11 15:15:38.591801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 170/335] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:38 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:39.633747 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:39.634680 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:39.642412 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:39.643133 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:39.643806 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:39.644699 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:39.645256 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:39.645782 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:39.819651 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:39.831960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:39.833832 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:39.835200 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-659d7abd-4d30-465a-bbc1-6bc42391933a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.207454 Sep 11 15:15:39.835826 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 166/336] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:39 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:40.862673 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:40.863401 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:40.872006 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:40.872006 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:40.872006 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:40.872530 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:40.872972 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:40.873429 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:41.056630 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:41.066595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:41.068054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:41.069306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7f162fcb-5f88-4848-9c77-e8b9e189af5d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.210684 Sep 11 15:15:41.069896 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 171/337] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:40 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:42.097646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:42.098698 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:42.107257 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:42.108044 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:42.108658 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:42.109636 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:42.110351 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:42.110987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:42.297091 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:42.315597 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:42.317889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:42.320610 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b7885c35-fd64-4417-a217-b2a568b78cc3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.228577 Sep 11 15:15:42.321657 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 167/338] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:42 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:43.364616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:43.365559 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:43.378219 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:43.379576 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:43.380256 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:43.381339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:43.382248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:43.382781 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:43.610191 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:43.625627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:43.627186 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:43.628407 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d420e937-d9e6-4995-9603-f2c08e029cc0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.271095 Sep 11 15:15:43.628981 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 172/339] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:43 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:44.655911 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:44.656958 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:44.664917 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:44.665556 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:44.666080 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:44.666890 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:44.667378 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:44.667859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:44.836660 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:44.846984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:44.848707 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:44.850410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ce2a61a5-eb33-44da-9c48-076b3d9ecd52 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.198915 Sep 11 15:15:44.865363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 168/340] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:44 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:45.876339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:45.877292 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:45.884771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:45.885288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:45.885903 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:45.886810 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:45.887248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:45.888012 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:46.031097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-93d6fc0c-56bb-4fbe-ab0a-6a8fa713dd1c req-21d5be77-df17-405e-b2a7-e55b4a3ab141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8", "name": "network-vif-plugged", "status": "completed", "tag": "0ee60018-4df2-40cf-8323-5711c188966a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:46.051395 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-93d6fc0c-56bb-4fbe-ab0a-6a8fa713dd1c req-21d5be77-df17-405e-b2a7-e55b4a3ab141 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:46.051983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-93d6fc0c-56bb-4fbe-ab0a-6a8fa713dd1c req-21d5be77-df17-405e-b2a7-e55b4a3ab141 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:46.053001 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-93d6fc0c-56bb-4fbe-ab0a-6a8fa713dd1c req-21d5be77-df17-405e-b2a7-e55b4a3ab141 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:46.081182 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-93d6fc0c-56bb-4fbe-ab0a-6a8fa713dd1c req-21d5be77-df17-405e-b2a7-e55b4a3ab141 service nova] Creating event network-vif-plugged:0ee60018-4df2-40cf-8323-5711c188966a for instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 on hv-cinder-83976 Sep 11 15:15:46.089732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-93d6fc0c-56bb-4fbe-ab0a-6a8fa713dd1c req-21d5be77-df17-405e-b2a7-e55b4a3ab141 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062377 Sep 11 15:15:46.092010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 169/341] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:15:46.127523 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:46.138814 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:46.140869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:46.142122 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-44fc116a-35ce-4fbb-b6c4-0d056cd92f16 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.269960 Sep 11 15:15:46.142815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 173/342] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:45 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:15:47.176517 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:47.177592 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:47.187572 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:47.188354 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:47.189049 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:47.190414 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:47.191158 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:47.191848 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:47.377609 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:47.388260 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:47.390248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:47.391612 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-14b7d06f-3e90-4a09-bfa6-2c5335141500 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.225590 Sep 11 15:15:47.394611 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 170/343] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:47 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:48.433682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:48.434254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:48.441092 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:48.441602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:48.442062 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:48.442745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:48.443161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:48.443760 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:48.617686 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:48.629069 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:48.631227 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:48.632737 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-33ae40b8-5a68-4670-8fc2-3c56a948dcd2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.202885 Sep 11 15:15:48.633691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 174/344] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:48 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:48.741656 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ca2786e6-4191-42ae-8024-3e0b4ef1c9ff tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:48.742514 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ca2786e6-4191-42ae-8024-3e0b4ef1c9ff tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:48.756171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca2786e6-4191-42ae-8024-3e0b4ef1c9ff tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:48.757361 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca2786e6-4191-42ae-8024-3e0b4ef1c9ff tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:48.757867 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca2786e6-4191-42ae-8024-3e0b4ef1c9ff tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:48.759496 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca2786e6-4191-42ae-8024-3e0b4ef1c9ff tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:48.760510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca2786e6-4191-42ae-8024-3e0b4ef1c9ff tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:48.766229 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca2786e6-4191-42ae-8024-3e0b4ef1c9ff tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:48.795653 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:48.808906 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ca2786e6-4191-42ae-8024-3e0b4ef1c9ff tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35/ips" status: 200 len: 150 microversion: 2.1 time: 0.074141 Sep 11 15:15:48.816490 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 171/345] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:15:48 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35/ips => generated 150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:15:48.831760 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "714daf82-ca03-416e-8bbc-07028ba12ff9"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:48.835893 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:48.847498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:48.848622 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:48.849347 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:48.850732 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:48.851727 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:48.852427 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:48.996108 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Invalid volume: volume 714daf82-ca03-416e-8bbc-07028ba12ff9 is already attached to instances: 57cbd483-4673-4cba-a512-0585e93c4b00 Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35/os-volume_attachments HTTP/1.1 Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 74 Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:15:48.998208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {"volumeAttachment": {"volumeId": "714daf82-ca03-416e-8bbc-07028ba12ff9"}} Sep 11 15:15:48.999762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Invalid volume: volume 714daf82-ca03-416e-8bbc-07028ba12ff9 is already attached to instances: 57cbd483-4673-4cba-a512-0585e93c4b00 Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'server_id': 'bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35', 'body': {'volumeAttachment': {'volumeId': '714daf82-ca03-416e-8bbc-07028ba12ff9'}}} Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 714daf82-ca03-416e-8bbc-07028ba12ff9 is already attached to instances: 57cbd483-4673-4cba-a512-0585e93c4b00 Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:15:49.000745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 714daf82-ca03-416e-8bbc-07028ba12ff9 is already attached to instances: 57cbd483-4673-4cba-a512-0585e93c4b00 Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:15:49.002157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:15:49.003590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:15:49.003590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:15:49.003590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:15:49.003590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 714daf82-ca03-416e-8bbc-07028ba12ff9 is already attached to instances: 57cbd483-4673-4cba-a512-0585e93c4b00 Sep 11 15:15:49.003590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:15:49.003590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 400 to user: Invalid volume: volume 714daf82-ca03-416e-8bbc-07028ba12ff9 is already attached to instances: 57cbd483-4673-4cba-a512-0585e93c4b00 {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:15:49.004058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-41b54466-0c76-4adc-ac47-e77911978a17 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.184569 Sep 11 15:15:49.004972 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 175/346] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:15:48 2022] POST /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35/os-volume_attachments => generated 174 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:15:49.014508 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:49.015275 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:49.022486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:49.023064 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:49.023803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:49.024622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:49.025320 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:49.025914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:49.074958 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:15:49.210482 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0918fd64-3f22-4241-a645-4789a80e62ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 204 len: 0 microversion: 2.1 time: 0.199862 Sep 11 15:15:49.211537 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 172/347] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:15:49 2022] DELETE /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 15:15:49.225564 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:49.226272 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:49.234319 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:49.234807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:49.235233 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:49.235941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:49.236481 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:49.237671 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:49.430209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:49.440840 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-44c0f450-cdac-40e8-a73c-1854622be3a0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1682 microversion: 2.1 time: 0.222547 Sep 11 15:15:49.441512 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 176/348] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:49 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:15:49.676357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:49.678032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:49.690325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:49.691493 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:49.692081 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:49.693569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:49.694393 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:49.695526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:49.923979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:49.934292 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:49.935754 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:49.936964 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1f97e2f5-53b4-4f6c-ba1b-59405285a9cb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1805 microversion: 2.20 time: 0.272181 Sep 11 15:15:49.937542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 173/349] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:49 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1805 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:50.468211 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:50.468781 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:50.476419 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:50.476911 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:50.477391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:50.478103 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:50.478557 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:50.478980 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:50.500094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:50.631002 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:50.639512 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-09d80a33-862d-4352-afb0-dbc1aa4e313b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1682 microversion: 2.1 time: 0.175795 Sep 11 15:15:50.640100 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 177/350] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:50 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:50.977667 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:50.979859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:50.991431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:50.992664 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:50.993524 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:50.994774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:50.995989 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:50.996736 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:51.211784 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:51.221486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:51.222951 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:51.224172 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-808b8509-001f-4fff-821d-f001d299f2f3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1792 microversion: 2.20 time: 0.262447 Sep 11 15:15:51.224750 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 174/351] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:15:50 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1792 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:15:51.670100 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:51.671194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:51.680333 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:51.681006 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:51.681671 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:51.682668 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:51.683268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:51.683815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:51.788747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:51.797729 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-18f8c87d-f2be-49dd-b83a-834b4955eb56 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1615 microversion: 2.1 time: 0.133814 Sep 11 15:15:51.798616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 178/352] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:51 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1615 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:15:52.131666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-376a81d3-0ca1-462e-a924-615a4ef1df49 req-34ce526d-0f75-4f0d-a52e-21f71f9421c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35", "name": "network-vif-deleted", "tag": "ae6aec31-6392-4cc4-856d-ec67402c382b"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:52.150014 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-376a81d3-0ca1-462e-a924-615a4ef1df49 req-34ce526d-0f75-4f0d-a52e-21f71f9421c7 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:52.150920 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-376a81d3-0ca1-462e-a924-615a4ef1df49 req-34ce526d-0f75-4f0d-a52e-21f71f9421c7 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:52.151533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-376a81d3-0ca1-462e-a924-615a4ef1df49 req-34ce526d-0f75-4f0d-a52e-21f71f9421c7 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:52.184397 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-376a81d3-0ca1-462e-a924-615a4ef1df49 req-34ce526d-0f75-4f0d-a52e-21f71f9421c7 service nova] Creating event network-vif-deleted:ae6aec31-6392-4cc4-856d-ec67402c382b for instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 on hv-cinder-83976 Sep 11 15:15:52.195430 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-376a81d3-0ca1-462e-a924-615a4ef1df49 req-34ce526d-0f75-4f0d-a52e-21f71f9421c7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070304 Sep 11 15:15:52.197391 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 175/353] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:15:52.822459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:52.823222 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:52.839470 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:52.840026 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:52.840475 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:52.841524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:52.842246 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:52.843123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:52.880834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:52.881354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:52.881829 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:52.882236 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lazy-loading 'fault' on Instance uuid bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:15:52.984651 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:53.003269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-df261b0c-032e-4831-8b7d-c2ccb8e3167a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 200 len: 1332 microversion: 2.1 time: 0.184442 Sep 11 15:15:53.005073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 179/354] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:52 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 1332 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:54.029721 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:54.030532 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:54.037674 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:54.038173 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:54.038600 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:54.039325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:54.039771 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:54.040187 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:54.056885 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 HTTP/1.1 Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:15:54.058666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:15:54.060251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35'} Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:15:54.061146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:15:54.062638 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:15:54.065317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:15:54.065317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9e83ab5f-2d50-490e-afc3-44bb33229cc5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 404 len: 111 microversion: 2.1 time: 0.035549 Sep 11 15:15:54.065317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 176/355] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:54 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 15:15:54.071753 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-443d947c-7f54-476a-b4ce-c9850ea217bd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '.version_select at 0x7f3938132310>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:54.097773 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-443d947c-7f54-476a-b4ce-c9850ea217bd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268308747" status: 202 len: 0 microversion: 2.1 time: 0.030161 Sep 11 15:15:54.098735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 180/356] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 15:15:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268308747 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:15:55.043944 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:55.044898 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:55.052075 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:55.052542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:55.053001 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:55.053777 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:55.054229 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:55.054633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:55.195193 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lazy-loading 'services' on Instance uuid 57cbd483-4673-4cba-a512-0585e93c4b00 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:15:55.325108 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6de3b931-0e24-413d-84ff-74cbf226c501 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-volume_attachments/714daf82-ca03-416e-8bbc-07028ba12ff9" status: 202 len: 0 microversion: 2.1 time: 0.284824 Sep 11 15:15:55.326122 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 177/357] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:15:55 2022] DELETE /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-volume_attachments/714daf82-ca03-416e-8bbc-07028ba12ff9 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:15:55.336374 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7774a42a-7916-492b-bd96-e8073f2ca900 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:55.339478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7774a42a-7916-492b-bd96-e8073f2ca900 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:55.346798 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7774a42a-7916-492b-bd96-e8073f2ca900 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:55.347452 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7774a42a-7916-492b-bd96-e8073f2ca900 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:55.348001 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7774a42a-7916-492b-bd96-e8073f2ca900 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:55.348844 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7774a42a-7916-492b-bd96-e8073f2ca900 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:55.349516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7774a42a-7916-492b-bd96-e8073f2ca900 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:55.350052 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7774a42a-7916-492b-bd96-e8073f2ca900 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:55.367356 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-711113b7-0517-4585-8825-455c728785f5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc6ac5a5-7eeb-4b23-9c56-820fb31f1128", "device": "/dev/sdb"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:55.371529 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-711113b7-0517-4585-8825-455c728785f5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:55.381094 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-711113b7-0517-4585-8825-455c728785f5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:55.381961 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-711113b7-0517-4585-8825-455c728785f5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:55.382334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-711113b7-0517-4585-8825-455c728785f5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:55.383178 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-711113b7-0517-4585-8825-455c728785f5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:55.383923 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-711113b7-0517-4585-8825-455c728785f5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:55.384503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-711113b7-0517-4585-8825-455c728785f5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:55.390897 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7774a42a-7916-492b-bd96-e8073f2ca900 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059500 Sep 11 15:15:55.391824 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 181/358] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:15:55 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:15:55.953923 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-711113b7-0517-4585-8825-455c728785f5 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "POST /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.590665 Sep 11 15:15:55.954752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 178/359] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:15:55 2022] POST /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:15:56.409077 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f624d9a2-7029-4685-b8c5-31a306326b4d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:56.411280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f624d9a2-7029-4685-b8c5-31a306326b4d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:56.418529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f624d9a2-7029-4685-b8c5-31a306326b4d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:56.419017 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f624d9a2-7029-4685-b8c5-31a306326b4d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:56.419447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f624d9a2-7029-4685-b8c5-31a306326b4d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:56.420150 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f624d9a2-7029-4685-b8c5-31a306326b4d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:56.420594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f624d9a2-7029-4685-b8c5-31a306326b4d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:56.421015 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f624d9a2-7029-4685-b8c5-31a306326b4d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:56.456239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f624d9a2-7029-4685-b8c5-31a306326b4d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051462 Sep 11 15:15:56.456847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 182/360] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:15:56 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 15:15:56.532427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:56.533084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:56.540674 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:56.541276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:56.541752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:56.542545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:56.543065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:56.543581 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:56.572682 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:15:56.678678 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-388f8d1b-1cd2-4a59-94f3-4d136b97e3a1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 204 len: 0 microversion: 2.1 time: 0.150893 Sep 11 15:15:56.679463 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 179/361] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:15:56 2022] DELETE /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 15:15:56.689593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:56.690225 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:56.697714 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:56.698408 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:56.698920 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:56.699908 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:56.700402 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:56.701019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:56.869959 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:56.879352 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7bc2074e-c858-4c25-8a65-318dad0528da tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1681 microversion: 2.1 time: 0.193783 Sep 11 15:15:56.879915 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 183/362] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:56 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:57.904100 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:57.905618 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:57.913646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:57.914183 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:57.914718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:57.915491 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:57.915981 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:57.916439 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:58.067736 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:58.077347 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8663d4c7-3e36-4770-ab66-916325385cf1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1681 microversion: 2.1 time: 0.177418 Sep 11 15:15:58.077976 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 180/363] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:57 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:15:59.102613 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:15:59.103964 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:15:59.113838 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:59.114453 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:59.115214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:59.116288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:59.116996 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:59.117692 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:59.227591 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:15:59.242466 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-14ff9dbd-a8af-44df-a0c0-5d55862538e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 200 len: 1614 microversion: 2.1 time: 0.144274 Sep 11 15:15:59.243496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 184/364] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:15:59 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 1614 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:15:59.523539 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-244afd07-1218-4838-80db-dfd3aad3f19b req-db136cc5-6191-486f-8d30-08bb0a15fe67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cbd483-4673-4cba-a512-0585e93c4b00", "name": "network-vif-deleted", "tag": "72bdc752-4b8d-42ff-ab81-964776f1883a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:15:59.529552 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 15:15:59.529733 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Sun Sep 11 15:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Sep 11 15:15:59.540928 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-244afd07-1218-4838-80db-dfd3aad3f19b req-db136cc5-6191-486f-8d30-08bb0a15fe67 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:15:59.541406 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-244afd07-1218-4838-80db-dfd3aad3f19b req-db136cc5-6191-486f-8d30-08bb0a15fe67 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:15:59.541842 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-244afd07-1218-4838-80db-dfd3aad3f19b req-db136cc5-6191-486f-8d30-08bb0a15fe67 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:15:59.556367 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-244afd07-1218-4838-80db-dfd3aad3f19b req-db136cc5-6191-486f-8d30-08bb0a15fe67 service nova] Creating event network-vif-deleted:72bdc752-4b8d-42ff-ab81-964776f1883a for instance 57cbd483-4673-4cba-a512-0585e93c4b00 on hv-cinder-83976 Sep 11 15:15:59.566697 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-244afd07-1218-4838-80db-dfd3aad3f19b req-db136cc5-6191-486f-8d30-08bb0a15fe67 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046840 Sep 11 15:15:59.567644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 181/365] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:00.283641 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:00.284350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:00.292777 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:00.293647 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:00.294408 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:00.295547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:00.296188 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:00.296818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:00.314053 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 HTTP/1.1 Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:16:00.316529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:16:00.318182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '57cbd483-4673-4cba-a512-0585e93c4b00'} Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:16:00.319085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:16:00.320577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:00.322883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:16:00.324139 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dfd44a21-1cc3-4059-bfae-63a6d498e766 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 404 len: 111 microversion: 2.1 time: 0.046084 Sep 11 15:16:00.329389 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 185/366] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:00 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:16:00.339939 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-83e5e504-ea7e-48e3-84ee-d384e5adabfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '.version_select at 0x7f39380e8e50>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:00.379974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-83e5e504-ea7e-48e3-84ee-d384e5adabfc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399691642" status: 202 len: 0 microversion: 2.1 time: 0.048591 Sep 11 15:16:00.380856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 182/367] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 15:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399691642 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:16:00.575087 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3719fbbd-9dda-45d4-b7ed-353e6e13da2e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb61490b-897c-4500-a596-f3e8aa91a926"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:00.588363 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3719fbbd-9dda-45d4-b7ed-353e6e13da2e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:00.595304 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3719fbbd-9dda-45d4-b7ed-353e6e13da2e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:00.595796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3719fbbd-9dda-45d4-b7ed-353e6e13da2e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:00.596219 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3719fbbd-9dda-45d4-b7ed-353e6e13da2e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:00.597367 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3719fbbd-9dda-45d4-b7ed-353e6e13da2e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:00.601411 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3719fbbd-9dda-45d4-b7ed-353e6e13da2e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:00.602273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3719fbbd-9dda-45d4-b7ed-353e6e13da2e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:00.976463 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3719fbbd-9dda-45d4-b7ed-353e6e13da2e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404931 Sep 11 15:16:00.977259 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 186/368] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:16:00 2022] POST /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:01.263937 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-986d479c-1618-40bd-9bc4-e196d6bc1f95 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: .version_select at 0x7f39380a99d0>, body: {"keypair": {"name": "tempest-keypair-1615983858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhWOixVXnnlPIvhIId72TbBIf94FgGpmbFSdV3teR/eCjC8EdiHyppx3cxkAq/hrLKcMsbUNJQFeDrlKNt38vVGSJshDH+G5RxNf/+0PQeMirvA/0JZuLZRhWHDOjg45A=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:01.280919 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-986d479c-1618-40bd-9bc4-e196d6bc1f95 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:16:01.285946 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-986d479c-1618-40bd-9bc4-e196d6bc1f95 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for user c44105f2d90e469fb03f311a4cf1476f and project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:16:01.311917 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-986d479c-1618-40bd-9bc4-e196d6bc1f95 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052360 Sep 11 15:16:01.312574 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 183/369] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:16:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:02.892056 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-412836298", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc5581c2-ebe9-4dd1-accb-09df241979bd"}], "security_groups": [{"name": "tempest-securitygroup--393987713"}], "key_name": "tempest-keypair-1615983858", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:03.034042 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] validate_networks() for [('fc5581c2-ebe9-4dd1-accb-09df241979bd', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:16:03.541847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:16:03.542266 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:16:03.542759 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:16:03.543160 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:16:03.543564 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:16:03.553598 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:03.554469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:03.554469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:03.555255 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:03.555755 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:03.556210 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:03.579898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:16:03.584553 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for user c44105f2d90e469fb03f311a4cf1476f and project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:16:03.596812 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:16:03.599310 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:16:03.652809 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-030d374a-961c-4ce8-b01c-148957a16794 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.765934 Sep 11 15:16:03.653542 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 187/370] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:16:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:16:03.665786 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-023debef-1f12-4c4d-a6a4-43609902789c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:03.666528 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-023debef-1f12-4c4d-a6a4-43609902789c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:03.753808 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-023debef-1f12-4c4d-a6a4-43609902789c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:03.766979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-023debef-1f12-4c4d-a6a4-43609902789c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1241 microversion: 2.1 time: 0.105245 Sep 11 15:16:03.777179 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 184/371] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:03 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:04.791738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:04.792546 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:04.794610 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:04.801741 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:04.802275 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:04.802716 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:04.803458 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:04.803919 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:04.804322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:04.874126 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:04.886978 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3c0c665e-9620-4eea-94f8-35adb4833f18 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1237 microversion: 2.1 time: 0.099594 Sep 11 15:16:04.887718 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 188/372] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:04 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:05.911518 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:05.912197 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:05.921100 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:05.921629 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:05.922067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:05.922805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:05.923255 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:05.923668 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:05.993243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:06.001806 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4669ceac-e7f0-4cf8-b7b7-9c590b7d5ece tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1237 microversion: 2.1 time: 0.094333 Sep 11 15:16:06.002393 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 185/373] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:05 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:07.025785 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:07.026411 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:07.033933 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:07.034427 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:07.034934 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:07.035546 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:07.035982 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:07.036418 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:07.119134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:07.130759 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4d120135-dcde-41d7-beb4-08fd7a96cfc0 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1293 microversion: 2.1 time: 0.108581 Sep 11 15:16:07.132082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 189/374] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:07 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:08.176888 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:08.178085 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:08.181772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:08.188491 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:08.189081 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:08.189716 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:08.190506 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:08.191109 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:08.191706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:08.333195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:08.350562 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-00a0a1ba-8dfe-4a1a-a9d8-2266e0ba4d33 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1299 microversion: 2.1 time: 0.182281 Sep 11 15:16:08.351381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 186/375] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:08 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1299 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:09.389446 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:09.390126 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:09.397085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:09.397594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:09.398019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:09.398707 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:09.399144 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:09.399552 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:09.543668 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:09.552203 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d3790054-be91-4c81-b853-940629a58ecc tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.166924 Sep 11 15:16:09.552859 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 190/376] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:09 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:10.577458 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:10.578214 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:10.587708 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:10.588230 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:10.588719 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:10.589940 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:10.590582 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:10.591287 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:10.752164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:10.755759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:10.761079 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-606d99a8-6e07-4aaf-91df-c57d5c618811 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.188679 Sep 11 15:16:10.761682 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 187/377] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:10 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:11.230717 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-ef75d4d5-3c49-4217-be63-5a976fe2a646 req-757bc167-b1b8-469b-910c-aca6e9ccf85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13dbbe8-b0bd-4845-9f5a-38f35a2415d1", "tag": "05549775-1936-4a9a-86d5-fa90ba19ba64"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:11.241071 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ef75d4d5-3c49-4217-be63-5a976fe2a646 req-757bc167-b1b8-469b-910c-aca6e9ccf85c service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:11.241595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ef75d4d5-3c49-4217-be63-5a976fe2a646 req-757bc167-b1b8-469b-910c-aca6e9ccf85c service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:11.242019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ef75d4d5-3c49-4217-be63-5a976fe2a646 req-757bc167-b1b8-469b-910c-aca6e9ccf85c service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:11.253984 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-ef75d4d5-3c49-4217-be63-5a976fe2a646 req-757bc167-b1b8-469b-910c-aca6e9ccf85c service nova] Creating event network-changed:05549775-1936-4a9a-86d5-fa90ba19ba64 for instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 on hv-cinder-83976 Sep 11 15:16:11.259249 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-ef75d4d5-3c49-4217-be63-5a976fe2a646 req-757bc167-b1b8-469b-910c-aca6e9ccf85c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032282 Sep 11 15:16:11.260514 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 191/378] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:11.784403 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:11.785018 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:11.793158 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:11.793723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:11.794085 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:11.794914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:11.795360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:11.795774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:11.946915 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:11.958354 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9f8563ab-8d6b-4e33-bf93-dd919fc0912d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.178144 Sep 11 15:16:11.968994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 188/379] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:11 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:12.947765 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:12.950052 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:12.957571 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:12.958030 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:12.958479 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:12.959168 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:12.959589 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:12.960003 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:12.985594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lazy-loading 'flavor' on Instance uuid cae96dd1-992b-4b45-b780-95ee7a2a4d0f {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:16:12.986770 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:12.987959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:12.999053 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:12.999615 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:13.000358 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:13.001593 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:13.002337 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:13.003303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:13.169679 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:13.170482 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-477abdef-9974-408d-ae22-cf19e10d6a76 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/action" status: 200 len: 32 microversion: 2.1 time: 0.228045 Sep 11 15:16:13.171274 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 192/380] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:16:12 2022] POST /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 15:16:13.179904 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d14bfb8a-52c8-4645-9c85-b19f5aa026e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.198734 Sep 11 15:16:13.180483 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 189/381] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:12 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:13.181592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:13.182295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:13.189384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:13.190020 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:13.190452 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:13.191212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:13.191737 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:13.192267 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:13.212665 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:13.344119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:13.354927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9f9061fe-a3b3-4724-b495-e73cbc0a92f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.176563 Sep 11 15:16:13.354927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 193/382] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:13 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:14.208454 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:14.209088 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:14.211191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:14.218186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:14.218707 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:14.219140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:14.219993 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:14.220526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:14.220952 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:14.380095 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:14.380948 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:14.383212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:14.384101 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:14.385416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:14.391103 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:14.391587 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:14.392017 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:14.392724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:14.393199 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:14.393620 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:14.394071 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a79f4c27-de06-47ab-a85a-9bed7713d502 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.189692 Sep 11 15:16:14.394655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 190/383] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:14 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:14.533513 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:14.542811 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8617b8f9-1a04-4e9d-8b92-8df5a9a828f8 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.167812 Sep 11 15:16:14.543424 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 194/384] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:14 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:15.431743 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:15.432685 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:15.440523 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:15.441024 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:15.441498 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:15.442214 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:15.442666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:15.443092 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:15.571186 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:15.572819 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:15.580512 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:15.580998 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:15.581502 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:15.582226 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:15.582684 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:15.583104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:15.617576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:15.628443 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ca38be4-e2c1-435d-a317-62bb8ecbbf73 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.201429 Sep 11 15:16:15.629117 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 191/385] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:15 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:15.724776 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:15.735278 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b90e3249-c570-4d7e-9bb0-5abf0c8fbed9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.171413 Sep 11 15:16:15.735870 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 195/386] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:15 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:16.651797 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:16.653175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:16.660247 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:16.660729 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:16.661183 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:16.661893 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:16.662343 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:16.662905 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:16.762559 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:16.764010 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:16.772459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:16.772963 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:16.773744 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:16.774498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:16.774943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:16.775354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:16.823055 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:16.833319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-56757b15-f71b-4acf-a3f1-2a88df8f5e6c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.185132 Sep 11 15:16:16.834251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 192/387] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:16 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:16.951971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:16.960498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7d8d5ea5-b0c0-4d49-aa53-384a028e05b9 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.205534 Sep 11 15:16:16.961119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 196/388] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:16 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:17.859666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:17.860458 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:17.867262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:17.867746 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:17.868171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:17.868871 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:17.869411 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:17.869807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:17.984604 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:17.986607 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:17.994087 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:17.995954 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:17.996533 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:17.997812 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:17.998745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:17.999425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:18.031980 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:18.055803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-717abf94-5d6b-4f8c-bf92-cc105b3268b1 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.200212 Sep 11 15:16:18.073234 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 193/389] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:17 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:18.157167 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:18.167097 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4b26627a-13c2-4351-8579-918d328551c0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.186300 Sep 11 15:16:18.167918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 197/390] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:17 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:19.087653 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:19.088413 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:19.096565 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:19.097058 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:19.097537 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:19.098238 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:19.098721 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:19.099138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:19.198013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:19.198787 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:19.206001 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:19.206494 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:19.206960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:19.207668 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:19.208099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:19.208539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:19.259022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:19.267932 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-acce8b3d-77ac-43b9-9b7d-1f92d2f0eb77 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.185649 Sep 11 15:16:19.268546 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 194/391] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:19 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:19.351590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:19.361242 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eaad1336-3ef6-40c8-b9e9-665a4c7e2c07 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.174049 Sep 11 15:16:19.361855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 198/392] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:19 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:16:20.232677 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:20.233476 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:20.245301 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:20.245987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:20.246688 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:20.247789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:20.248633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:20.249409 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:20.291542 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:20.292912 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:20.300104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:20.300775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:20.301369 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:20.302176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:20.302863 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:20.303381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:20.404414 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lazy-loading 'services' on Instance uuid 2d94e54a-a4f8-46af-b908-554e5a7e2977 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:16:20.478870 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:20.491134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6e459b12-359d-455b-937a-1e8633bb590c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.203295 Sep 11 15:16:20.492149 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 199/393] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:20 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:16:20.500007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-527e7876-7d5b-48dc-8f5e-9e735924e90c req-0c26b75f-6544-4bb8-96dc-5cace2dec35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13dbbe8-b0bd-4845-9f5a-38f35a2415d1", "name": "network-vif-plugged", "status": "completed", "tag": "05549775-1936-4a9a-86d5-fa90ba19ba64"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:20.514058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-527e7876-7d5b-48dc-8f5e-9e735924e90c req-0c26b75f-6544-4bb8-96dc-5cace2dec35d service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:20.514799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-527e7876-7d5b-48dc-8f5e-9e735924e90c req-0c26b75f-6544-4bb8-96dc-5cace2dec35d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:20.515284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-527e7876-7d5b-48dc-8f5e-9e735924e90c req-0c26b75f-6544-4bb8-96dc-5cace2dec35d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:20.516132 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dabf4fb4-c4e3-45db-a19c-069657bc2de6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977/os-volume_attachments/fc6ac5a5-7eeb-4b23-9c56-820fb31f1128" status: 202 len: 0 microversion: 2.1 time: 0.290691 Sep 11 15:16:20.517375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 195/394] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:16:20 2022] DELETE /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977/os-volume_attachments/fc6ac5a5-7eeb-4b23-9c56-820fb31f1128 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:16:20.529737 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-527e7876-7d5b-48dc-8f5e-9e735924e90c req-0c26b75f-6544-4bb8-96dc-5cace2dec35d service nova] Creating event network-vif-plugged:05549775-1936-4a9a-86d5-fa90ba19ba64 for instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 on hv-cinder-83976 Sep 11 15:16:20.531123 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:20.532519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:20.537340 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-527e7876-7d5b-48dc-8f5e-9e735924e90c req-0c26b75f-6544-4bb8-96dc-5cace2dec35d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043542 Sep 11 15:16:20.538296 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 200/395] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:20.543856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:20.544948 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:20.545987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:20.547055 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:20.548319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:20.549174 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:20.741561 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:20.751397 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5807c7d-6211-42fe-9f74-ddf694cb6259 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.232233 Sep 11 15:16:20.751998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 196/396] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:20 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:21.517624 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:21.518331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:21.524944 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:21.525478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:21.525911 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:21.526635 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:21.527076 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:21.527526 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:21.684743 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:21.693582 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-74598f5b-d6e0-4e9a-87d5-95b5c27ab439 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.180676 Sep 11 15:16:21.694565 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 201/397] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:21 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:21.706991 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:21.707540 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:21.714415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:21.714930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:21.715356 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:21.716060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:21.716508 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:21.716922 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:21.743065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:16:21.775042 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:21.775652 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:21.781743 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:21.782275 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:21.782716 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:21.783423 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:21.783856 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:21.784280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:21.829042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f1d8cf0c-04cc-4e95-b386-848c3b55c396 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 204 len: 0 microversion: 2.1 time: 0.125726 Sep 11 15:16:21.829703 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 197/398] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:16:21 2022] DELETE /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:16:21.838367 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:21.839057 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:21.845202 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:21.845684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:21.846107 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:21.846799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:21.847242 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:21.847656 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:21.989865 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:22.009922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ae941dd2-46b2-42fb-8ba7-c0b028180c92 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.238142 Sep 11 15:16:22.011641 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 202/399] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:21 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:16:22.056763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:22.064983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-45ee6954-7ac3-4621-9e2e-fd90ecd42ad8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1514 microversion: 2.1 time: 0.230751 Sep 11 15:16:22.065598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 198/400] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:21 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:16:22.717516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:22.718058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:22.725066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:22.725572 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:22.726006 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:22.726697 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:22.727126 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:22.727550 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:22.872690 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:22.881975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d677df19-8573-45b1-8ad2-e5fc031f3fe7 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1366 microversion: 2.1 time: 0.168486 Sep 11 15:16:22.882558 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 203/401] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:22 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:23.040435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:23.041012 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:23.048190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:23.049165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:23.049165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:23.049811 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:23.050272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:23.050680 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:23.088139 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:23.088711 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:23.095225 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:23.095599 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:23.095856 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:23.096552 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:23.096996 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:23.097447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:23.247588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:23.259006 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-09d52514-21cb-460a-bcd5-52edf352225f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.222213 Sep 11 15:16:23.259814 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 199/402] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:23 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:23.276132 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:23.292635 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e7ec9420-0d91-4161-b519-992426dcd7f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1514 microversion: 2.1 time: 0.208199 Sep 11 15:16:23.293110 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 204/403] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:23 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:23.904394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:23.905034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:23.911438 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:23.911921 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:23.912339 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:23.913023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:23.913496 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:23.913909 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:24.284472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:24.285091 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:24.293160 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:24.293670 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:24.294108 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:24.294846 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:24.295306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:24.295729 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:24.319379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:24.333976 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e98676b0-6c6a-4f80-9fd6-99e1a417a5be tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1556 microversion: 2.1 time: 0.432984 Sep 11 15:16:24.336335 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 200/404] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:23 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1556 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:24.346029 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:24.347604 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:24.358999 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:24.359616 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:24.360387 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:24.361383 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:24.362181 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:24.362666 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:24.532920 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:24.544838 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-191b7ec5-27d5-4434-9fb4-3f6406b6bfe0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.264455 Sep 11 15:16:24.550977 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 205/405] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:24 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:24.560242 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3c349caf-e2c0-4c32-8342-eaf276a2721b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:24.561596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3c349caf-e2c0-4c32-8342-eaf276a2721b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:24.573414 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c349caf-e2c0-4c32-8342-eaf276a2721b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:24.574291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c349caf-e2c0-4c32-8342-eaf276a2721b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:24.575082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c349caf-e2c0-4c32-8342-eaf276a2721b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:24.576307 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c349caf-e2c0-4c32-8342-eaf276a2721b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:24.577175 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c349caf-e2c0-4c32-8342-eaf276a2721b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:24.577906 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c349caf-e2c0-4c32-8342-eaf276a2721b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:24.584220 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:24.599241 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d97a242f-ca23-47ed-a1cd-6d7aa2726180 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1514 microversion: 2.1 time: 0.260694 Sep 11 15:16:24.600283 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 201/406] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:24 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:24.678795 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3c349caf-e2c0-4c32-8342-eaf276a2721b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125737 Sep 11 15:16:24.679860 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 206/407] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 15:16:24 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:24.893095 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-e59b1178-1b68-4477-bdaf-cd2f53d219f9 req-2a5fb045-b35a-4ab8-bc42-60f845682787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d94e54a-a4f8-46af-b908-554e5a7e2977", "name": "network-vif-deleted", "tag": "8b5f6c9a-31cc-4ab9-b171-9313a5f7c315"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:24.914387 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e59b1178-1b68-4477-bdaf-cd2f53d219f9 req-2a5fb045-b35a-4ab8-bc42-60f845682787 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:24.915355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e59b1178-1b68-4477-bdaf-cd2f53d219f9 req-2a5fb045-b35a-4ab8-bc42-60f845682787 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:24.916211 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e59b1178-1b68-4477-bdaf-cd2f53d219f9 req-2a5fb045-b35a-4ab8-bc42-60f845682787 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:24.929868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:24.947817 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-e59b1178-1b68-4477-bdaf-cd2f53d219f9 req-2a5fb045-b35a-4ab8-bc42-60f845682787 service nova] Creating event network-vif-deleted:8b5f6c9a-31cc-4ab9-b171-9313a5f7c315 for instance 2d94e54a-a4f8-46af-b908-554e5a7e2977 on hv-cinder-83976 Sep 11 15:16:24.958457 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-e59b1178-1b68-4477-bdaf-cd2f53d219f9 req-2a5fb045-b35a-4ab8-bc42-60f845682787 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071949 Sep 11 15:16:24.959654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 202/408] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:25.587245 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:25.587834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:25.594630 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:25.594832 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:25.595315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:25.596246 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:25.596853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:25.597315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:25.625911 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:25.627941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:25.637257 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:25.638037 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:25.638787 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:25.639504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:25.640020 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:25.640477 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:25.677383 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:25.678522 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:25.679123 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:25.679603 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lazy-loading 'fault' on Instance uuid 2d94e54a-a4f8-46af-b908-554e5a7e2977 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:16:25.750195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:25.757752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-574765f6-dca0-4a89-96b9-380b04f7f832 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 200 len: 1309 microversion: 2.1 time: 0.136733 Sep 11 15:16:25.760213 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 203/409] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:25 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:25.828969 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:25.837825 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-614beec6-00cd-4ae3-a699-5ce528e1a4f1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.269072 Sep 11 15:16:25.838307 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 207/410] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:25 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:25.973020 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-3e99149c-8287-4729-a86b-8ac549d9cde0 req-5d11f0ea-6594-46a4-8240-1642488944ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13dbbe8-b0bd-4845-9f5a-38f35a2415d1", "tag": "05549775-1936-4a9a-86d5-fa90ba19ba64"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:25.982878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-3e99149c-8287-4729-a86b-8ac549d9cde0 req-5d11f0ea-6594-46a4-8240-1642488944ed service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:25.983355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-3e99149c-8287-4729-a86b-8ac549d9cde0 req-5d11f0ea-6594-46a4-8240-1642488944ed service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:25.983779 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-3e99149c-8287-4729-a86b-8ac549d9cde0 req-5d11f0ea-6594-46a4-8240-1642488944ed service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:25.995106 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-3e99149c-8287-4729-a86b-8ac549d9cde0 req-5d11f0ea-6594-46a4-8240-1642488944ed service nova] Creating event network-changed:05549775-1936-4a9a-86d5-fa90ba19ba64 for instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 on hv-cinder-83976 Sep 11 15:16:26.000668 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-3e99149c-8287-4729-a86b-8ac549d9cde0 req-5d11f0ea-6594-46a4-8240-1642488944ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031323 Sep 11 15:16:26.002135 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 204/411] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:26.781263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:26.782254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: 2d94e54a-a4f8-46af-b908-554e5a7e2977] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:26.793366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:26.794015 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:26.794451 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:26.795163 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:26.795610 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:26.796226 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:26.812548 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] HTTP exception thrown: Instance 2d94e54a-a4f8-46af-b908-554e5a7e2977 could not be found. Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Request method failure captured: Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 HTTP/1.1 Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfuD1rqsJhXgzOuwkVbESYdm9wioEgliutezwAoGI4RGY4L3vjJ6OOXL9uj6su56DYpE6-bqh7OlArppZdXzzft6FJuLxJusybbhURK6NwjjvT8CWYuPaHvoqsnXSfMgapkdOJlVhQDGXzJ_nvEcuFFt1Bx7hx2D0SnhKmRRr2ssAhM Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: fd7984f5434f42098fb127572b6d1e0c Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesSnapshotTestJSON-989814129 Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:16:26.814393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd7984f5434f42098fb127572b6d1e0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd7984f5434f42098fb127572b6d1e0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd7984f5434f42098fb127572b6d1e0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd7984f5434f42098fb127572b6d1e0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesSnapshotTestJSON-989814129 Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: fd7984f5434f42098fb127572b6d1e0c Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-989814129 Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesSnapshotTestJSON-989814129-project Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 0292da3873ef419097717fd11337a128 Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesSnapshotTestJSON-989814129-project Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 2d94e54a-a4f8-46af-b908-554e5a7e2977 could not be found. Sep 11 15:16:26.816061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '2d94e54a-a4f8-46af-b908-554e5a7e2977'} Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d94e54a-a4f8-46af-b908-554e5a7e2977 could not be found. Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:16:26.816953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d94e54a-a4f8-46af-b908-554e5a7e2977 could not be found. Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d94e54a-a4f8-46af-b908-554e5a7e2977 could not be found. Sep 11 15:16:26.818493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:16:26.820067 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Returning 404 to user: Instance 2d94e54a-a4f8-46af-b908-554e5a7e2977 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:16:26.820067 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c6696092-b34b-4e60-bc5c-f767cc28a95f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977" status: 404 len: 111 microversion: 2.1 time: 0.038552 Sep 11 15:16:26.820228 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 208/412] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:26 2022] GET /compute/v2.1/servers/2d94e54a-a4f8-46af-b908-554e5a7e2977 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:16:26.863027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:26.863930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:26.873878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:26.874269 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:26.874947 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:26.875641 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:26.876109 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:26.876658 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:27.040292 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:27.049033 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6b5cc168-a345-4d57-8f23-24402d6989f2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.190997 Sep 11 15:16:27.049664 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 205/413] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:26 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:28.072537 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:28.073267 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:28.080832 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:28.081329 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:28.081768 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:28.082459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:28.082913 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:28.083356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:28.226845 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:28.235947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cef363b6-7518-4241-be99-fd57fb511344 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.167686 Sep 11 15:16:28.236440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 209/414] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:28 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:29.260219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:29.260759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:29.267935 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:29.268496 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:29.268927 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:29.269661 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:29.270113 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:29.270533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:29.418469 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:29.427216 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c1244069-e0ce-4e17-b448-36e28c069fc4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.171217 Sep 11 15:16:29.427825 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 206/415] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:29 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:30.452450 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:30.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:30.460218 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:30.460747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:30.461180 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:30.461948 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:30.462392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:30.462852 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:30.606124 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:30.615255 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3e3effdb-13d6-442f-b3e3-d0599dea4bcf tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.167768 Sep 11 15:16:30.615822 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 210/416] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:30 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:31.638098 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:31.638820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:31.646159 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:31.646622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:31.647109 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:31.647898 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:31.648357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:31.649360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:31.805627 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:31.815094 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4cc8d86c-cb38-467f-b1e8-f3d205a04dd3 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.180808 Sep 11 15:16:31.815695 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 207/417] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:31 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:32.843109 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:32.843842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:32.853617 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:32.854303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:32.854914 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:32.855888 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:32.856520 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:32.857113 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:33.009242 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:33.012917 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:33.019111 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-148feed5-1361-4e3f-9cee-38f3a98b99b1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.181690 Sep 11 15:16:33.019680 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 211/418] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:32 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:34.043522 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:34.044133 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:34.051094 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:34.051577 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:34.052011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:34.052700 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:34.053235 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:34.053678 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:34.198435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:34.210046 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-506c576c-99c2-4297-aa36-009d73f80c65 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.170502 Sep 11 15:16:34.210645 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 208/419] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:34 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:34.514961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d13193b6-e857-4270-9939-9c6e240991df tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:34.515557 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d13193b6-e857-4270-9939-9c6e240991df tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:34.522974 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13193b6-e857-4270-9939-9c6e240991df tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:34.523429 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13193b6-e857-4270-9939-9c6e240991df tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:34.523880 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13193b6-e857-4270-9939-9c6e240991df tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:34.524558 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13193b6-e857-4270-9939-9c6e240991df tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:34.524995 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13193b6-e857-4270-9939-9c6e240991df tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:34.525428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13193b6-e857-4270-9939-9c6e240991df tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:34.558918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d13193b6-e857-4270-9939-9c6e240991df tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments/be3a4c6a-e20e-4ca6-970a-fb019dd32cad" status: 200 len: 194 microversion: 2.20 time: 0.047879 Sep 11 15:16:34.559431 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 212/420] 10.222.0.44 () {60 vars in 1454 bytes} [Sun Sep 11 15:16:34 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments/be3a4c6a-e20e-4ca6-970a-fb019dd32cad => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:16:34.637495 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:34.637977 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:34.644336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:34.644824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:34.645274 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:34.645986 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:34.646438 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:34.646852 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:34.734201 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lazy-loading 'services' on Instance uuid 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:16:34.788619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-747962119", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "networks": [{"uuid": "027902dc-3f28-4764-a469-9d558d48f138"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:34.812229 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4129435d-6a4b-441e-8aa7-a3a7147e093f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "DELETE /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments/be3a4c6a-e20e-4ca6-970a-fb019dd32cad" status: 202 len: 0 microversion: 2.20 time: 0.178683 Sep 11 15:16:34.815646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 209/421] 10.222.0.44 () {60 vars in 1457 bytes} [Sun Sep 11 15:16:34 2022] DELETE /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments/be3a4c6a-e20e-4ca6-970a-fb019dd32cad => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:16:34.822323 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0ceeb2eb-88d8-4724-a841-c596348655e9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:34.824623 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0ceeb2eb-88d8-4724-a841-c596348655e9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:34.830902 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ceeb2eb-88d8-4724-a841-c596348655e9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:34.831441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ceeb2eb-88d8-4724-a841-c596348655e9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:34.831875 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ceeb2eb-88d8-4724-a841-c596348655e9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:34.832565 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ceeb2eb-88d8-4724-a841-c596348655e9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:34.833070 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ceeb2eb-88d8-4724-a841-c596348655e9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:34.833557 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ceeb2eb-88d8-4724-a841-c596348655e9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:34.848738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] validate_networks() for [('027902dc-3f28-4764-a469-9d558d48f138', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:16:34.864705 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0ceeb2eb-88d8-4724-a841-c596348655e9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046827 Sep 11 15:16:34.865294 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 210/422] 10.222.0.44 () {60 vars in 1343 bytes} [Sun Sep 11 15:16:34 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 15:16:35.216989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:16:35.217432 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:16:35.217925 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:16:35.218323 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:16:35.218721 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:16:35.220735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=52 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:35.229450 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:35.229937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:35.230355 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:35.231100 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:35.231527 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:35.231938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:35.234622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:35.235830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:35.242234 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:35.242722 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:35.243150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:35.243844 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:35.244290 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:35.244707 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:35.249982 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Getting quotas for project fd7984f5434f42098fb127572b6d1e0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:16:35.254419 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Getting quotas for user 0292da3873ef419097717fd11337a128 and project fd7984f5434f42098fb127572b6d1e0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:16:35.267345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:16:35.269704 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:16:35.317856 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b5a6a92c-9314-47e8-acd1-2d0afac6d264 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533169 Sep 11 15:16:35.319215 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 213/423] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:16:35.330735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f98321f6-bb39-4999-a34a-3a7a36b0291d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:35.331344 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f98321f6-bb39-4999-a34a-3a7a36b0291d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:35.397726 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f98321f6-bb39-4999-a34a-3a7a36b0291d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:35.413177 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f98321f6-bb39-4999-a34a-3a7a36b0291d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1218 microversion: 2.1 time: 0.086139 Sep 11 15:16:35.414342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 214/424] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:35 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:16:35.425449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:35.436983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5e9f941-f783-4447-927d-29adce616e95 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.206489 Sep 11 15:16:35.437718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 211/425] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:35 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:35.878235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bf6fc647-2a17-469e-aabd-fbd51bf8f099 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:35.880550 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bf6fc647-2a17-469e-aabd-fbd51bf8f099 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:35.887636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf6fc647-2a17-469e-aabd-fbd51bf8f099 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:35.888118 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf6fc647-2a17-469e-aabd-fbd51bf8f099 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:35.888547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf6fc647-2a17-469e-aabd-fbd51bf8f099 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:35.889281 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf6fc647-2a17-469e-aabd-fbd51bf8f099 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:35.889735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf6fc647-2a17-469e-aabd-fbd51bf8f099 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:35.890151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf6fc647-2a17-469e-aabd-fbd51bf8f099 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:35.920362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bf6fc647-2a17-469e-aabd-fbd51bf8f099 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046146 Sep 11 15:16:35.920836 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 215/426] 10.222.0.44 () {60 vars in 1343 bytes} [Sun Sep 11 15:16:35 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:16:36.439363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:36.440200 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:36.449306 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:36.449803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:36.451218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:36.452316 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:36.453078 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:36.453551 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:36.464785 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:36.465428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:36.472671 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:36.473373 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:36.474102 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:36.475184 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:36.475950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:36.476578 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:36.527272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:36.537542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6672adcb-53e5-4051-b8f5-e0d3855d0bce tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1214 microversion: 2.1 time: 0.102845 Sep 11 15:16:36.538748 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 212/427] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:36 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:36.660923 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:36.669469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-63c23585-deab-4a21-b0c9-e0d21b8d7797 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.209304 Sep 11 15:16:36.670059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 216/428] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:36 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:16:36.933691 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7e4be345-f818-4e5c-8110-84f05543d7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:36.936711 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7e4be345-f818-4e5c-8110-84f05543d7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:36.945027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e4be345-f818-4e5c-8110-84f05543d7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:36.945628 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e4be345-f818-4e5c-8110-84f05543d7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:36.946225 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e4be345-f818-4e5c-8110-84f05543d7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:36.947517 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e4be345-f818-4e5c-8110-84f05543d7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:36.948222 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e4be345-f818-4e5c-8110-84f05543d7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:36.949008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e4be345-f818-4e5c-8110-84f05543d7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:36.983838 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7e4be345-f818-4e5c-8110-84f05543d7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054378 Sep 11 15:16:36.984744 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 213/429] 10.222.0.44 () {60 vars in 1343 bytes} [Sun Sep 11 15:16:36 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:37.052948 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:37.053603 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:37.060539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:37.061025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:37.061539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:37.062244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:37.063350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:37.063350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:37.092357 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:16:37.184502 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-82e1b8f4-7483-45be-a525-9027b3acc5c5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "DELETE /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 204 len: 0 microversion: 2.20 time: 0.135093 Sep 11 15:16:37.185220 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 217/430] 10.222.0.44 () {60 vars in 1280 bytes} [Sun Sep 11 15:16:37 2022] DELETE /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 15:16:37.194166 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:37.195010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:37.201375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:37.201858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:37.202286 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:37.203032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:37.203495 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:37.203910 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:37.346309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:37.358419 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:37.360655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:37.362368 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d938d68c-83b5-4dac-80fa-6e3c0cafa28e tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.172544 Sep 11 15:16:37.363130 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 214/431] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:37 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:37.562361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:37.563093 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:37.570759 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:37.571241 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:37.571670 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:37.572365 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:37.572811 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:37.573335 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:37.642443 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:37.650649 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a100b213-63b7-4aa9-9d90-554e06956cf8 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1270 microversion: 2.1 time: 0.092644 Sep 11 15:16:37.651216 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 218/432] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:37 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:37.693772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:37.694359 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:37.701075 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:37.701592 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:37.702015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:37.702701 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:37.703139 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:37.703550 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:37.859740 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:37.868466 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f9c4ee56-866d-4f36-91fb-2b1dcc6757cd tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1738 microversion: 2.1 time: 0.178898 Sep 11 15:16:37.869174 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 215/433] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:37 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:38.389311 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:38.389932 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:38.396696 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:38.397170 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:38.397611 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:38.398294 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:38.398759 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:38.399169 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:38.537024 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:38.545950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:38.547365 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:38.548506 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-82dfd74d-754f-4a44-a579-475ca6d7f363 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.163220 Sep 11 15:16:38.549088 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 219/434] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:38 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:38.674695 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:38.675299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:38.677387 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:38.683511 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:38.683995 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:38.684537 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:38.685354 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:38.685808 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:38.686240 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:38.757553 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:38.765621 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6bb18d8b-c035-4850-bf72-b22fd9af666d tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1270 microversion: 2.1 time: 0.094987 Sep 11 15:16:38.766286 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 216/435] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:38 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:38.897591 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:38.898261 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:38.905185 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:38.905659 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:38.906085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:38.906764 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:38.907207 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:38.907617 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.051171 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:39.059598 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6f8109a0-1971-4f14-8d7a-fa0f54bd23b5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1718 microversion: 2.1 time: 0.167361 Sep 11 15:16:39.060165 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 220/436] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:38 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1718 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:39.185479 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:39.185960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:39.192437 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.192916 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.193732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.194458 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.194905 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.195312 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.284392 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] HTTP exception thrown: Cannot 'detach_volume' instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f while it is in vm_state rescued Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Request method failure captured: Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments/cb61490b-897c-4500-a596-f3e8aa91a926 HTTP/1.1 Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrnpbJ4tYApu2HZiYVfH1ap7MKgo-OUf63y1EMdUS7c2C0Cyk0CXffOTT7TvUzCOKJeukeE8FSdqt1DqlhZSFyHN8iGlJfL7-w16CPok_KAr5O78YL_Ns6MtrmdddYXVleAKY6YUhYcUGweuANbGmFHEFc1dEIquEj-BU1TXuggVp0 Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:16:39.286102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7933806a47704d2d867be7312890b538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7933806a47704d2d867be7312890b538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 2bd47bf9aa4142b1b7ec8d02e8661578 Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:16:39.287655 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Cannot 'detach_volume' instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f while it is in vm_state rescued Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'server_id': 'cae96dd1-992b-4b45-b780-95ee7a2a4d0f', 'id': 'cb61490b-897c-4500-a596-f3e8aa91a926'} Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:16:39.288309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f while it is in vm_state rescued Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f while it is in vm_state rescued Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:39.289830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Returning 409 to user: Cannot 'detach_volume' instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f while it is in vm_state rescued {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:16:39.291042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c504ec8b-12cf-463c-8049-832d01c7b6b2 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments/cb61490b-897c-4500-a596-f3e8aa91a926" status: 409 len: 152 microversion: 2.1 time: 0.106125 Sep 11 15:16:39.291042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 217/437] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:16:39 2022] DELETE /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments/cb61490b-897c-4500-a596-f3e8aa91a926 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 11 15:16:39.296694 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-168d8a61-e5a0-45ca-aacf-c43b58ca709d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:39.297248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-168d8a61-e5a0-45ca-aacf-c43b58ca709d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:39.303608 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-168d8a61-e5a0-45ca-aacf-c43b58ca709d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.304087 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-168d8a61-e5a0-45ca-aacf-c43b58ca709d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.304516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-168d8a61-e5a0-45ca-aacf-c43b58ca709d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.305241 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-168d8a61-e5a0-45ca-aacf-c43b58ca709d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.305690 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-168d8a61-e5a0-45ca-aacf-c43b58ca709d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.306349 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-168d8a61-e5a0-45ca-aacf-c43b58ca709d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.381795 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-168d8a61-e5a0-45ca-aacf-c43b58ca709d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "POST /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/action" status: 202 len: 0 microversion: 2.1 time: 0.088761 Sep 11 15:16:39.382435 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 221/438] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:16:39 2022] POST /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:16:39.391682 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:39.392286 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:39.398360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.398849 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.399287 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.399977 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.400420 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.400971 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.569503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:39.575751 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:39.576599 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:39.578529 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-11beac80-4f95-4a98-98e7-a5a25d048bf1 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1726 microversion: 2.1 time: 0.190691 Sep 11 15:16:39.579118 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 218/439] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:39 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:39.585162 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.586126 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.586877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.587969 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.588752 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.589404 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.742935 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:39.752311 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:39.753710 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:39.754930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-afc5ad37-3f19-45dd-9be6-c794e8411966 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.183733 Sep 11 15:16:39.755591 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 222/440] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:39 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:16:39.791604 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:39.792525 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:39.803908 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.804781 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.805593 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.806849 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:39.807605 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:39.808205 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:39.815381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:39.924633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:39.937511 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-10cece46-7d1a-4567-b109-06a9d3f10f9b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1278 microversion: 2.1 time: 0.151493 Sep 11 15:16:39.949185 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 219/441] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:39 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:40.603303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:40.603905 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:40.610564 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:40.611150 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:40.611474 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:40.612161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:40.612605 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:40.613018 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:40.746226 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:40.754582 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-25026f22-0b17-4710-9e31-af4909d00f1f tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1726 microversion: 2.1 time: 0.155415 Sep 11 15:16:40.755151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 223/442] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:40 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:40.780424 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:40.781059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:40.787351 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:40.788081 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:40.788510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:40.789617 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:40.790057 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:40.790473 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:40.927865 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:40.940575 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:40.942840 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:40.944974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1381b681-6fb0-4e20-8b62-1194ab0217c1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1720 microversion: 2.20 time: 0.168799 Sep 11 15:16:40.945814 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 220/443] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:40 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:40.963424 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:40.964181 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:40.970706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:40.971268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:40.971747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:40.972536 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:40.972979 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:40.973422 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:41.044242 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:41.052020 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dd4c3c28-f5f2-44e6-af53-062b869069ae tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1276 microversion: 2.1 time: 0.092538 Sep 11 15:16:41.052615 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 224/444] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:40 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:41.779172 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:41.780160 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:41.787069 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:41.787809 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:41.788243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:41.788928 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:41.789406 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:41.789818 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:41.816457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-6d0f0c98-a8ee-4367-9a11-62cd74617206 req-a46e034c-82ad-4868-b69b-628690920a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8", "name": "network-vif-deleted", "tag": "0ee60018-4df2-40cf-8323-5711c188966a"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:41.839286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6d0f0c98-a8ee-4367-9a11-62cd74617206 req-a46e034c-82ad-4868-b69b-628690920a64 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:41.839908 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6d0f0c98-a8ee-4367-9a11-62cd74617206 req-a46e034c-82ad-4868-b69b-628690920a64 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:41.840440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6d0f0c98-a8ee-4367-9a11-62cd74617206 req-a46e034c-82ad-4868-b69b-628690920a64 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:41.854048 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-6d0f0c98-a8ee-4367-9a11-62cd74617206 req-a46e034c-82ad-4868-b69b-628690920a64 service nova] Creating event network-vif-deleted:0ee60018-4df2-40cf-8323-5711c188966a for instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 on hv-cinder-83976 Sep 11 15:16:41.859048 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-6d0f0c98-a8ee-4367-9a11-62cd74617206 req-a46e034c-82ad-4868-b69b-628690920a64 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046507 Sep 11 15:16:41.859918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 225/445] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:41.928473 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:41.937478 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0fbb76c5-f9d4-49d7-a143-c651f59a4644 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1726 microversion: 2.1 time: 0.162581 Sep 11 15:16:41.938052 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 221/446] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:41 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:41.973761 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:41.974447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:41.980939 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:41.981422 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:41.981846 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:41.982531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:41.982973 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:41.983384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:42.048179 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:42.056843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:42.058333 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:42.059504 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5abfd8ca-f3e2-40ef-83c3-e416f5865b8f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1653 microversion: 2.20 time: 0.090124 Sep 11 15:16:42.060039 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 226/447] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:41 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:42.077622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:42.078379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:42.085570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:42.086164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:42.086773 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:42.087608 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:42.088158 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:42.088672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:42.236722 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:42.246091 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-15f10941-4036-4c67-9da9-dbcaa19d58b2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1318 microversion: 2.1 time: 0.174000 Sep 11 15:16:42.255173 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 222/448] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:42 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:42.962164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:42.962932 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:42.970903 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:42.971620 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:42.972302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:42.973497 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:42.974405 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:42.975064 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:43.084136 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:43.084763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:43.091542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:43.095051 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:43.095659 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:43.096393 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:43.096839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:43.097288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:43.126997 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:43.129434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:43.129913 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:43.130342 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:43.130801 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lazy-loading 'fault' on Instance uuid 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:16:43.135662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a7af6c3a-1c21-460c-9797-c247c826503d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1732 microversion: 2.1 time: 0.177669 Sep 11 15:16:43.136373 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 227/449] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:42 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:43.160517 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a47c9e0c-3de3-482d-95d6-143a0273dc4a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:43.160887 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a47c9e0c-3de3-482d-95d6-143a0273dc4a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:43.168403 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a47c9e0c-3de3-482d-95d6-143a0273dc4a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:43.168882 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a47c9e0c-3de3-482d-95d6-143a0273dc4a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:43.169344 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a47c9e0c-3de3-482d-95d6-143a0273dc4a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:43.170070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a47c9e0c-3de3-482d-95d6-143a0273dc4a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:43.170510 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a47c9e0c-3de3-482d-95d6-143a0273dc4a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:43.171145 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a47c9e0c-3de3-482d-95d6-143a0273dc4a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:43.172959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:43.175320 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:43.182700 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:43.184176 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:43.185363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e25ea661-e3b2-4a7a-85fd-1c9585360450 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 200 len: 1369 microversion: 2.20 time: 0.105278 Sep 11 15:16:43.186333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 223/450] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:43 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:43.257863 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a47c9e0c-3de3-482d-95d6-143a0273dc4a tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101964 Sep 11 15:16:43.258497 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 228/451] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 15:16:43 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:43.274414 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:43.275354 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:43.282802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:43.283511 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:43.284147 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:43.285070 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:43.285745 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:43.286381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:43.531222 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:43.541421 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d1b7b0b1-7ce1-477a-9d81-de8f009b628b tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1318 microversion: 2.1 time: 0.270825 Sep 11 15:16:43.542113 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 224/452] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:43 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:43.877478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-2ff49712-dfcc-4506-9dc5-017b8c45f3d8 req-6172555e-abc7-4e80-a058-1ba2d93ec9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a683d2f3-d434-4377-80fa-7d16bd4d7331", "tag": "1dda7d49-2368-486d-aa4d-9bbf7ae14b43"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:43.887853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2ff49712-dfcc-4506-9dc5-017b8c45f3d8 req-6172555e-abc7-4e80-a058-1ba2d93ec9e6 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:43.888305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2ff49712-dfcc-4506-9dc5-017b8c45f3d8 req-6172555e-abc7-4e80-a058-1ba2d93ec9e6 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:43.889162 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2ff49712-dfcc-4506-9dc5-017b8c45f3d8 req-6172555e-abc7-4e80-a058-1ba2d93ec9e6 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:43.902760 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-2ff49712-dfcc-4506-9dc5-017b8c45f3d8 req-6172555e-abc7-4e80-a058-1ba2d93ec9e6 service nova] Creating event network-changed:1dda7d49-2368-486d-aa4d-9bbf7ae14b43 for instance a683d2f3-d434-4377-80fa-7d16bd4d7331 on hv-cinder-83976 Sep 11 15:16:43.907625 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-2ff49712-dfcc-4506-9dc5-017b8c45f3d8 req-6172555e-abc7-4e80-a058-1ba2d93ec9e6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034389 Sep 11 15:16:43.908229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 229/453] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:44.211284 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:44.211837 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:44.219048 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:44.219597 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:44.220114 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:44.220732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:44.221164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:44.221609 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:44.236447 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] HTTP exception thrown: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Request method failure captured: Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 HTTP/1.1 Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkSz-jPKw4ydAqryLH9fFmYQbx5rsFJC-Us0nk4nw8YK_PNmX-whCkkXIQVWsIddOfAt7vR-uHe0DGclszL-rZ2ZEKXegUxxmCj-2Fs2JfyAHFWmpw7atcaXEq7HI_rj2jR6PYH2PxPq0tO3eIJoTRVix1YINTPK4H90w3gnwFaV0 Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:16:44.237805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2273d07b98054e3987568fc043597b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2273d07b98054e3987568fc043597b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 5e4f8b13b66449cf849ff9cb73938c4c Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:16:44.239148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8'} Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:16:44.239941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:16:44.241104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:16:44.242211 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Returning 404 to user: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:16:44.242211 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ee3936c-1c3a-47cc-b65e-22d316f1afb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 404 len: 111 microversion: 2.20 time: 0.032137 Sep 11 15:16:44.242211 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 225/454] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:44 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:16:44.249985 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aae2dd6e-7ccc-4d94-9fd5-acdb5bc2e61b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '.version_select at 0x7f393807edc0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:44.273989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aae2dd6e-7ccc-4d94-9fd5-acdb5bc2e61b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176226477" status: 204 len: 0 microversion: 2.20 time: 0.028630 Sep 11 15:16:44.275331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 230/455] 10.222.0.44 () {60 vars in 1259 bytes} [Sun Sep 11 15:16:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176226477 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 15:16:44.565435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:44.573544 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-340a0a3e-f8fe-40f4-ad79-cec097fcc73e req-38df957e-1692-49e0-aefe-581686fcc89a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae96dd1-992b-4b45-b780-95ee7a2a4d0f", "tag": "0d49c605-6c2c-4c31-80df-739077e3707e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:44.573657 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:44.580165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:44.580859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:44.581483 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:44.582401 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:44.582990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:44.583649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:44.593663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-340a0a3e-f8fe-40f4-ad79-cec097fcc73e req-38df957e-1692-49e0-aefe-581686fcc89a service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:44.594288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-340a0a3e-f8fe-40f4-ad79-cec097fcc73e req-38df957e-1692-49e0-aefe-581686fcc89a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:44.601358 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-340a0a3e-f8fe-40f4-ad79-cec097fcc73e req-38df957e-1692-49e0-aefe-581686fcc89a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:44.620354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-340a0a3e-f8fe-40f4-ad79-cec097fcc73e req-38df957e-1692-49e0-aefe-581686fcc89a service nova] Creating event network-changed:0d49c605-6c2c-4c31-80df-739077e3707e for instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f on hv-cinder-83976 Sep 11 15:16:44.628087 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-340a0a3e-f8fe-40f4-ad79-cec097fcc73e req-38df957e-1692-49e0-aefe-581686fcc89a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060801 Sep 11 15:16:44.629539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 231/456] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:16:44.935066 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:44.945035 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b38123ff-dce9-41aa-8d2f-5b676e79b2f6 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1318 microversion: 2.1 time: 0.383599 Sep 11 15:16:44.957914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 226/457] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:44 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:45.298650 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3d002e7d-cfbf-4fa3-bc04-b112854d0d84 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'create', calling method: .version_select at 0x7f3938085310>, body: {"keypair": {"name": "tempest-keypair-150284956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMyuXYUhaMpPINJFXNSuH1ehhAzMysrK1mBmEP5L+ElHm6bbmIfPoyxbMYcpzGGPeSo9E5RBnNhH+To3Bp0gYG7IbfqDlJ9H4Y/OzkDBL+uecfzMtHvN0VZiZLPqxJqwA=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:45.305350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:45.321048 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3d002e7d-cfbf-4fa3-bc04-b112854d0d84 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Getting quotas for project 2273d07b98054e3987568fc043597b78. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:16:45.325852 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3d002e7d-cfbf-4fa3-bc04-b112854d0d84 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Getting quotas for user 5e4f8b13b66449cf849ff9cb73938c4c and project 2273d07b98054e3987568fc043597b78. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:16:45.353476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3d002e7d-cfbf-4fa3-bc04-b112854d0d84 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.059076 Sep 11 15:16:45.354384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 232/458] 10.222.0.44 () {62 vars in 1200 bytes} [Sun Sep 11 15:16:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 11 15:16:45.971683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:45.972384 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:45.979699 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:45.980137 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:45.980656 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:45.981465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:45.981968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:45.982454 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:46.192766 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:46.203041 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dacfeb68-4710-40b5-8474-a83d2178b6fb tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1318 microversion: 2.1 time: 0.236541 Sep 11 15:16:46.203607 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 227/459] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:45 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:46.650935 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-534040a8-3337-4fc2-964b-38aa438f85fc req-fea54193-4af4-4817-9c51-5f0b6ef49020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae96dd1-992b-4b45-b780-95ee7a2a4d0f", "tag": "0d49c605-6c2c-4c31-80df-739077e3707e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:46.663070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-534040a8-3337-4fc2-964b-38aa438f85fc req-fea54193-4af4-4817-9c51-5f0b6ef49020 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:46.663705 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-534040a8-3337-4fc2-964b-38aa438f85fc req-fea54193-4af4-4817-9c51-5f0b6ef49020 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:46.664339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-534040a8-3337-4fc2-964b-38aa438f85fc req-fea54193-4af4-4817-9c51-5f0b6ef49020 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:46.677277 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-534040a8-3337-4fc2-964b-38aa438f85fc req-fea54193-4af4-4817-9c51-5f0b6ef49020 service nova] Creating event network-changed:0d49c605-6c2c-4c31-80df-739077e3707e for instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f on hv-cinder-83976 Sep 11 15:16:46.682906 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-534040a8-3337-4fc2-964b-38aa438f85fc req-fea54193-4af4-4817-9c51-5f0b6ef49020 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036040 Sep 11 15:16:46.683565 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 233/460] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:46.963782 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-643627281", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1578d7cc-1ac5-4c14-9f57-a1b6b975982d"}], "security_groups": [{"name": "tempest-securitygroup--1236837008"}], "key_name": "tempest-keypair-150284956", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:47.075825 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] validate_networks() for [('1578d7cc-1ac5-4c14-9f57-a1b6b975982d', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:16:47.227883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:47.228695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:47.235877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:47.236697 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:47.237118 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:47.238127 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:47.238850 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:47.239188 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:47.477229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:47.485333 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-064227cb-333a-4ff1-aecf-5333c99ef1f2 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1318 microversion: 2.1 time: 0.261545 Sep 11 15:16:47.485884 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 234/461] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:47 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:47.582878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:16:47.583290 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:16:47.583755 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:16:47.584146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:16:47.584537 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:16:47.596171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:47.596654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:47.597209 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:47.597939 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:47.598416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:47.598882 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:47.616951 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Getting quotas for project 2273d07b98054e3987568fc043597b78. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:16:47.621471 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Getting quotas for user 5e4f8b13b66449cf849ff9cb73938c4c and project 2273d07b98054e3987568fc043597b78. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:16:47.633270 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:16:47.635743 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:16:47.698271 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-51effabc-d94f-4184-9179-e5b10d0761aa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.739907 Sep 11 15:16:47.698990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 228/462] 10.222.0.44 () {62 vars in 1188 bytes} [Sun Sep 11 15:16:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 11 15:16:47.711836 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a07e80cf-e3f7-4fa8-a05a-136fc2c7434f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:47.712669 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a07e80cf-e3f7-4fa8-a05a-136fc2c7434f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:47.772260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a07e80cf-e3f7-4fa8-a05a-136fc2c7434f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:47.781063 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a07e80cf-e3f7-4fa8-a05a-136fc2c7434f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:47.782582 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a07e80cf-e3f7-4fa8-a05a-136fc2c7434f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:47.783658 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a07e80cf-e3f7-4fa8-a05a-136fc2c7434f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1280 microversion: 2.20 time: 0.075878 Sep 11 15:16:47.784214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 235/463] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:47 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:48.358056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-61f26d3e-2b23-4226-9026-42896942892b req-d4ec61d6-ea21-41d0-afc6-738463908712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a683d2f3-d434-4377-80fa-7d16bd4d7331", "name": "network-vif-plugged", "status": "completed", "tag": "1dda7d49-2368-486d-aa4d-9bbf7ae14b43"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:48.372622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-61f26d3e-2b23-4226-9026-42896942892b req-d4ec61d6-ea21-41d0-afc6-738463908712 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:48.373933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-61f26d3e-2b23-4226-9026-42896942892b req-d4ec61d6-ea21-41d0-afc6-738463908712 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:48.374643 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-61f26d3e-2b23-4226-9026-42896942892b req-d4ec61d6-ea21-41d0-afc6-738463908712 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:48.388990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-61f26d3e-2b23-4226-9026-42896942892b req-d4ec61d6-ea21-41d0-afc6-738463908712 service nova] Creating event network-vif-plugged:1dda7d49-2368-486d-aa4d-9bbf7ae14b43 for instance a683d2f3-d434-4377-80fa-7d16bd4d7331 on hv-cinder-83976 Sep 11 15:16:48.394432 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-61f26d3e-2b23-4226-9026-42896942892b req-d4ec61d6-ea21-41d0-afc6-738463908712 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041151 Sep 11 15:16:48.395262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 229/464] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:48.509833 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:48.510543 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:48.520766 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:48.521630 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:48.522096 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:48.522903 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:48.523357 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:48.523775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:48.679598 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:48.687870 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ec9fe057-cc92-4c5b-a554-9dff156dbf45 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1318 microversion: 2.1 time: 0.182480 Sep 11 15:16:48.688439 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 236/465] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:48 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:48.808309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:48.809018 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:48.815644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:48.816130 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:48.816559 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:48.817286 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:48.817748 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:48.818644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:48.912688 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:48.921641 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:48.923077 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:48.924194 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0a14c70c-4f5b-4e57-b346-1bb94c8af78a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1332 microversion: 2.20 time: 0.120315 Sep 11 15:16:48.924772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 230/466] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:48 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:49.711381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:49.711950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:49.719195 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:49.719735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:49.720162 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:49.721005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:49.721371 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:49.721786 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:49.890340 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:49.899445 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2cf7429c-92f0-4b8a-be9c-13e67d198061 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1318 microversion: 2.1 time: 0.191968 Sep 11 15:16:49.900034 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 237/467] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:49 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:49.967299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:49.967998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:49.975231 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:49.975707 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:49.976138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:49.976841 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:49.977335 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:49.977757 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:50.057715 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:50.067908 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:50.070017 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:50.071489 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3442766d-9cc5-459b-81ec-b763a3ae75e2 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1338 microversion: 2.20 time: 0.108193 Sep 11 15:16:50.072221 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 231/468] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:49 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:50.924453 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:50.925227 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:50.933579 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:50.934066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:50.934483 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:50.935206 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:50.935648 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:50.936061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:51.085852 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:51.095519 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a42f3166-3765-4445-bcc8-57f2ffe3be6a tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1508 microversion: 2.1 time: 0.176156 Sep 11 15:16:51.095949 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b275f7b5-37e8-42e2-bc08-5e5f430b73fd req-02198d88-e4d2-4a8b-840e-5636f4574973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ed2d84-4e3f-48cd-98a1-00bc736956fa", "tag": "dc11bee5-2af5-4d4d-9c05-1df367d916f1"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:51.107023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b275f7b5-37e8-42e2-bc08-5e5f430b73fd req-02198d88-e4d2-4a8b-840e-5636f4574973 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:51.107551 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b275f7b5-37e8-42e2-bc08-5e5f430b73fd req-02198d88-e4d2-4a8b-840e-5636f4574973 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:51.108099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b275f7b5-37e8-42e2-bc08-5e5f430b73fd req-02198d88-e4d2-4a8b-840e-5636f4574973 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:51.113065 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 238/469] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:16:50 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:16:51.117845 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:51.118438 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:51.121936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b275f7b5-37e8-42e2-bc08-5e5f430b73fd req-02198d88-e4d2-4a8b-840e-5636f4574973 service nova] Creating event network-changed:dc11bee5-2af5-4d4d-9c05-1df367d916f1 for instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa on hv-cinder-83976 Sep 11 15:16:51.125362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:51.126065 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:51.126662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:51.127564 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:51.128005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:51.128407 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:51.133326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b275f7b5-37e8-42e2-bc08-5e5f430b73fd req-02198d88-e4d2-4a8b-840e-5636f4574973 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042064 Sep 11 15:16:51.133984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 232/470] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:51.141180 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ae4349df-8de4-4c4c-92db-d978d8150035 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbc7792e-d379-466f-a004-ca23526eae06", "device": "/dev/sdb"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:51.144291 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ae4349df-8de4-4c4c-92db-d978d8150035 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:51.150918 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae4349df-8de4-4c4c-92db-d978d8150035 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:51.151403 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae4349df-8de4-4c4c-92db-d978d8150035 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:51.152001 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae4349df-8de4-4c4c-92db-d978d8150035 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:51.152703 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae4349df-8de4-4c4c-92db-d978d8150035 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:51.153174 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae4349df-8de4-4c4c-92db-d978d8150035 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:51.153599 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae4349df-8de4-4c4c-92db-d978d8150035 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:51.281320 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:51.290137 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:51.291794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:51.292932 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-541f30e6-e11d-4aba-99ff-8f7b516706cd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1406 microversion: 2.20 time: 0.179021 Sep 11 15:16:51.293661 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 239/471] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:51 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:51.437611 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ae4349df-8de4-4c4c-92db-d978d8150035 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "POST /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301946 Sep 11 15:16:51.438799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 233/472] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:16:51 2022] POST /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:52.317777 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:52.318882 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:52.325800 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:52.326277 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:52.326700 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:52.327415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:52.327883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:52.328296 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:52.475887 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:52.484271 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:52.485754 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:52.486854 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f5d1b36c-7716-40a5-b1d9-788e174e75da tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1406 microversion: 2.20 time: 0.173016 Sep 11 15:16:52.487415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 240/473] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:52 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:53.512401 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:53.513110 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:53.521357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:53.521841 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:53.522268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:53.522968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:53.523414 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:53.523844 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:53.670546 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:53.679085 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:53.680491 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:53.681723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-32e235fe-41fb-483d-bf1a-c5a9d68e9e4f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1406 microversion: 2.20 time: 0.173787 Sep 11 15:16:53.682273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 234/474] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:53 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:54.707073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:54.707880 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:54.714566 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:54.715043 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:54.715469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:54.716167 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:54.716608 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:54.717016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:54.908497 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:54.918295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:54.919839 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:54.921332 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e0391882-86de-4052-aaee-cf4b15aa8e7d tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1406 microversion: 2.20 time: 0.218257 Sep 11 15:16:54.922041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 241/475] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:54 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:55.948602 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:55.949521 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:55.957581 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:55.958068 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:55.958499 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:55.959208 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:55.959654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:55.960060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:56.120184 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:56.129383 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:56.130873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:56.132036 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-909bab37-cff7-4ccf-9233-012970a87b98 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1406 microversion: 2.20 time: 0.188238 Sep 11 15:16:56.132619 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 235/476] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:55 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:56.380684 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-635f8f90-017e-42ef-9d48-5c6a8af3e71f req-4321a818-8bf0-42ba-ab2e-f059fc90fb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ed2d84-4e3f-48cd-98a1-00bc736956fa", "name": "network-vif-plugged", "status": "completed", "tag": "dc11bee5-2af5-4d4d-9c05-1df367d916f1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:56.393545 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-635f8f90-017e-42ef-9d48-5c6a8af3e71f req-4321a818-8bf0-42ba-ab2e-f059fc90fb39 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:56.394259 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-635f8f90-017e-42ef-9d48-5c6a8af3e71f req-4321a818-8bf0-42ba-ab2e-f059fc90fb39 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:56.394886 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-635f8f90-017e-42ef-9d48-5c6a8af3e71f req-4321a818-8bf0-42ba-ab2e-f059fc90fb39 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:56.417248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-635f8f90-017e-42ef-9d48-5c6a8af3e71f req-4321a818-8bf0-42ba-ab2e-f059fc90fb39 service nova] Creating event network-vif-plugged:dc11bee5-2af5-4d4d-9c05-1df367d916f1 for instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa on hv-cinder-83976 Sep 11 15:16:56.426474 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-635f8f90-017e-42ef-9d48-5c6a8af3e71f req-4321a818-8bf0-42ba-ab2e-f059fc90fb39 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049215 Sep 11 15:16:56.427615 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 242/477] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:16:57.157473 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:57.158173 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:57.165344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:57.165921 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:57.166349 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:57.167067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:57.167526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:57.167947 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:57.318884 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:57.322771 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:57.328752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:57.330204 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:57.331328 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ef8ac150-25aa-4d58-b5d2-69b54f92f7fe tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1406 microversion: 2.20 time: 0.178095 Sep 11 15:16:57.331904 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 236/478] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:57 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:58.355988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=14 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:58.361469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:58.362326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:58.371070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:58.371561 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:58.371991 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:58.372689 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:58.373128 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:58.373571 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:58.521472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:58.529968 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:58.531386 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:16:58.532548 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8a594734-62b3-4c31-b0a0-16451a1a9388 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1598 microversion: 2.20 time: 0.179188 Sep 11 15:16:58.533103 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 243/479] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:16:58 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:16:58.558575 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-31226440-ca61-4c4a-b3c1-7ebdb3fb4efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:16:58.559219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-31226440-ca61-4c4a-b3c1-7ebdb3fb4efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:16:58.561059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:58.561742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:16:58.569630 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31226440-ca61-4c4a-b3c1-7ebdb3fb4efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:58.570133 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31226440-ca61-4c4a-b3c1-7ebdb3fb4efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:58.570558 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31226440-ca61-4c4a-b3c1-7ebdb3fb4efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:58.571283 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31226440-ca61-4c4a-b3c1-7ebdb3fb4efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:58.571718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31226440-ca61-4c4a-b3c1-7ebdb3fb4efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:58.572243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31226440-ca61-4c4a-b3c1-7ebdb3fb4efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:58.660579 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-31226440-ca61-4c4a-b3c1-7ebdb3fb4efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106279 Sep 11 15:16:58.661513 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 237/480] 10.222.0.44 () {60 vars in 1316 bytes} [Sun Sep 11 15:16:58 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:16:59.868961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-f153f98d-0b59-43f1-9174-fbf9e849cdbe req-ac6d2235-d4f8-4df9-8036-c85458764fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ed2d84-4e3f-48cd-98a1-00bc736956fa", "tag": "dc11bee5-2af5-4d4d-9c05-1df367d916f1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:16:59.879066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f153f98d-0b59-43f1-9174-fbf9e849cdbe req-ac6d2235-d4f8-4df9-8036-c85458764fd4 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:16:59.879555 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f153f98d-0b59-43f1-9174-fbf9e849cdbe req-ac6d2235-d4f8-4df9-8036-c85458764fd4 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:16:59.879950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f153f98d-0b59-43f1-9174-fbf9e849cdbe req-ac6d2235-d4f8-4df9-8036-c85458764fd4 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:16:59.891755 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-f153f98d-0b59-43f1-9174-fbf9e849cdbe req-ac6d2235-d4f8-4df9-8036-c85458764fd4 service nova] Creating event network-changed:dc11bee5-2af5-4d4d-9c05-1df367d916f1 for instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa on hv-cinder-83976 Sep 11 15:16:59.896619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-f153f98d-0b59-43f1-9174-fbf9e849cdbe req-ac6d2235-d4f8-4df9-8036-c85458764fd4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031415 Sep 11 15:16:59.897491 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 244/481] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:02.303485 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-68d8570c-f37b-4fa1-9e9c-424faf212a15 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:02.304022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-68d8570c-f37b-4fa1-9e9c-424faf212a15 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:02.310872 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68d8570c-f37b-4fa1-9e9c-424faf212a15 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:02.311346 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68d8570c-f37b-4fa1-9e9c-424faf212a15 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:02.311778 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68d8570c-f37b-4fa1-9e9c-424faf212a15 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:02.312455 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68d8570c-f37b-4fa1-9e9c-424faf212a15 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:02.312902 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68d8570c-f37b-4fa1-9e9c-424faf212a15 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:02.313349 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68d8570c-f37b-4fa1-9e9c-424faf212a15 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:02.338025 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-68d8570c-f37b-4fa1-9e9c-424faf212a15 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/ips" status: 200 len: 150 microversion: 2.1 time: 0.039148 Sep 11 15:17:02.338610 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 238/482] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:17:02 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:04.761390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-639d71a3-199c-449d-a122-6b8f826cc9a9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3c0a073-0dd2-43e9-b026-432768e85bf3"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:04.764704 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-639d71a3-199c-449d-a122-6b8f826cc9a9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:04.771616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-639d71a3-199c-449d-a122-6b8f826cc9a9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:04.772105 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-639d71a3-199c-449d-a122-6b8f826cc9a9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:04.772537 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-639d71a3-199c-449d-a122-6b8f826cc9a9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:04.773282 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-639d71a3-199c-449d-a122-6b8f826cc9a9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:04.773737 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-639d71a3-199c-449d-a122-6b8f826cc9a9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:04.774189 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-639d71a3-199c-449d-a122-6b8f826cc9a9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:07.712570 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-639d71a3-199c-449d-a122-6b8f826cc9a9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.958460 Sep 11 15:17:07.713585 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 245/483] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:17:04 2022] POST /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments => generated 194 bytes in 2961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:12.144133 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:12.144992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:12.149542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:12.157696 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:12.158203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:12.158641 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:12.159370 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:12.159822 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:12.160245 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:12.254221 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lazy-loading 'services' on Instance uuid a683d2f3-d434-4377-80fa-7d16bd4d7331 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:17:12.340057 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-43e14447-730d-4925-8cd3-ecf90c8cc896 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331/os-volume_attachments/cbc7792e-d379-466f-a004-ca23526eae06" status: 202 len: 0 microversion: 2.1 time: 0.202940 Sep 11 15:17:12.340661 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 239/484] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:17:12 2022] DELETE /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331/os-volume_attachments/cbc7792e-d379-466f-a004-ca23526eae06 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:17:15.346108 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:15.353481 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3c0a073-0dd2-43e9-b026-432768e85bf3"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:15.356398 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:15.367312 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.367834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.368268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.368977 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.369877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.370305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.374482 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:15.469021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Invalid volume: volume a3c0a073-0dd2-43e9-b026-432768e85bf3 is already attached to instances: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments HTTP/1.1 Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 74 Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:17:15.470733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {"volumeAttachment": {"volumeId": "a3c0a073-0dd2-43e9-b026-432768e85bf3"}} Sep 11 15:17:15.472164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Invalid volume: volume a3c0a073-0dd2-43e9-b026-432768e85bf3 is already attached to instances: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'server_id': 'd13dbbe8-b0bd-4845-9f5a-38f35a2415d1', 'body': {'volumeAttachment': {'volumeId': 'a3c0a073-0dd2-43e9-b026-432768e85bf3'}}} Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a3c0a073-0dd2-43e9-b026-432768e85bf3 is already attached to instances: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:15.472921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a3c0a073-0dd2-43e9-b026-432768e85bf3 is already attached to instances: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:15.474390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:15.475855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:15.475855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:17:15.475855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:17:15.475855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a3c0a073-0dd2-43e9-b026-432768e85bf3 is already attached to instances: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 Sep 11 15:17:15.475855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:15.475855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 400 to user: Invalid volume: volume a3c0a073-0dd2-43e9-b026-432768e85bf3 is already attached to instances: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:17:15.475855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-418f3130-48e5-454f-93e5-c6dae354253e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128217 Sep 11 15:17:15.475855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 246/485] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:17:15 2022] POST /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:17:15.555057 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:15.555816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:15.563317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.563654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.564094 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.564799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.565281 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.565724 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.628683 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:15.629490 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:15.637292 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.638116 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.638741 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.639635 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.640082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.640491 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.666349 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lazy-loading 'services' on Instance uuid d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:17:15.672317 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:17:15.755482 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d42a3c03-15cf-44c4-9b53-4fe4d497f4e8 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments/a3c0a073-0dd2-43e9-b026-432768e85bf3" status: 202 len: 0 microversion: 2.1 time: 0.204479 Sep 11 15:17:15.756196 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 240/486] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:17:15 2022] DELETE /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments/a3c0a073-0dd2-43e9-b026-432768e85bf3 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:17:15.768360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-042ec25f-7587-4fb0-9371-830d938a31ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:15.769985 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9666992d-16b7-4526-95a8-1a1dab16dd57 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 204 len: 0 microversion: 2.1 time: 0.145960 Sep 11 15:17:15.770546 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 247/487] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:17:15 2022] DELETE /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:17:15.776930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-042ec25f-7587-4fb0-9371-830d938a31ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:15.781581 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:15.782621 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:15.786179 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-042ec25f-7587-4fb0-9371-830d938a31ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.787458 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-042ec25f-7587-4fb0-9371-830d938a31ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.788085 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-042ec25f-7587-4fb0-9371-830d938a31ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.789197 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.789521 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-042ec25f-7587-4fb0-9371-830d938a31ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.789844 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.790130 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.790423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-042ec25f-7587-4fb0-9371-830d938a31ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.791043 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:15.791280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-042ec25f-7587-4fb0-9371-830d938a31ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.791559 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:15.792172 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:15.831844 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-042ec25f-7587-4fb0-9371-830d938a31ec tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070282 Sep 11 15:17:15.832430 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 241/488] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:17:15 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:15.954504 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:15.964254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ad2a74cc-fe8d-4609-a564-226356f86a4f tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1514 microversion: 2.1 time: 0.187624 Sep 11 15:17:15.964847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 248/489] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:15 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:16.845798 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5d9b6103-7801-4af4-9454-ea412febd1b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:16.848029 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5d9b6103-7801-4af4-9454-ea412febd1b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:16.855449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9b6103-7801-4af4-9454-ea412febd1b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:16.855994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9b6103-7801-4af4-9454-ea412febd1b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:16.856364 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9b6103-7801-4af4-9454-ea412febd1b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:16.857242 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9b6103-7801-4af4-9454-ea412febd1b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:16.857694 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9b6103-7801-4af4-9454-ea412febd1b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:16.858341 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9b6103-7801-4af4-9454-ea412febd1b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:16.894993 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5d9b6103-7801-4af4-9454-ea412febd1b6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053493 Sep 11 15:17:16.895788 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 242/490] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:17:16 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:16.988452 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:16.989055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:16.996525 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:16.997028 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:16.997527 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:16.998267 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:16.998728 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:16.999149 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:17.192740 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:17.202227 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c8d030e9-3774-46a7-8ee0-906a8a7e4a30 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1514 microversion: 2.1 time: 0.217820 Sep 11 15:17:17.202989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 249/491] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:16 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:17:17.908757 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-56e60ea7-62d7-4d66-a9b9-31a9a482dcbb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:17.911087 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-56e60ea7-62d7-4d66-a9b9-31a9a482dcbb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:17.918680 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56e60ea7-62d7-4d66-a9b9-31a9a482dcbb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:17.919184 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56e60ea7-62d7-4d66-a9b9-31a9a482dcbb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:17.919626 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56e60ea7-62d7-4d66-a9b9-31a9a482dcbb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:17.920358 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56e60ea7-62d7-4d66-a9b9-31a9a482dcbb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:17.920806 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56e60ea7-62d7-4d66-a9b9-31a9a482dcbb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:17.921249 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56e60ea7-62d7-4d66-a9b9-31a9a482dcbb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:17.958930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-56e60ea7-62d7-4d66-a9b9-31a9a482dcbb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054488 Sep 11 15:17:17.959534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 243/492] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:17:17 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:18.230866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:18.232285 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:18.243892 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:18.244952 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:18.245632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:18.246983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:18.247857 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:18.248806 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:18.407270 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:18.422044 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d7239bc2-7cd4-4d1c-85ac-a3795c7518f7 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1514 microversion: 2.1 time: 0.197471 Sep 11 15:17:18.423120 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 250/493] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:18 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:18.571377 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-2c5a72bb-97c8-4ec8-8cd3-2bbba37b8a4d req-a689f291-7bdd-4ee0-8906-a5895a2fc35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a683d2f3-d434-4377-80fa-7d16bd4d7331", "name": "network-vif-deleted", "tag": "1dda7d49-2368-486d-aa4d-9bbf7ae14b43"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:18.583251 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-2c5a72bb-97c8-4ec8-8cd3-2bbba37b8a4d req-a689f291-7bdd-4ee0-8906-a5895a2fc35c service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:18.583886 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-2c5a72bb-97c8-4ec8-8cd3-2bbba37b8a4d req-a689f291-7bdd-4ee0-8906-a5895a2fc35c service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:18.584323 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-2c5a72bb-97c8-4ec8-8cd3-2bbba37b8a4d req-a689f291-7bdd-4ee0-8906-a5895a2fc35c service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:18.597822 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-2c5a72bb-97c8-4ec8-8cd3-2bbba37b8a4d req-a689f291-7bdd-4ee0-8906-a5895a2fc35c service nova] Creating event network-vif-deleted:1dda7d49-2368-486d-aa4d-9bbf7ae14b43 for instance a683d2f3-d434-4377-80fa-7d16bd4d7331 on hv-cinder-83976 Sep 11 15:17:18.603083 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-2c5a72bb-97c8-4ec8-8cd3-2bbba37b8a4d req-a689f291-7bdd-4ee0-8906-a5895a2fc35c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035929 Sep 11 15:17:18.603749 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 244/494] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:18.972849 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-94de9402-e5cf-4065-92fc-76f78c428064 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:18.975262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-94de9402-e5cf-4065-92fc-76f78c428064 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:18.982446 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94de9402-e5cf-4065-92fc-76f78c428064 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:18.982939 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94de9402-e5cf-4065-92fc-76f78c428064 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:18.983365 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94de9402-e5cf-4065-92fc-76f78c428064 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:18.984114 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94de9402-e5cf-4065-92fc-76f78c428064 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:18.984552 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94de9402-e5cf-4065-92fc-76f78c428064 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:18.984969 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94de9402-e5cf-4065-92fc-76f78c428064 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:19.018100 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-94de9402-e5cf-4065-92fc-76f78c428064 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049687 Sep 11 15:17:19.018709 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 251/495] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:17:18 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 15:17:19.117697 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:19.118953 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:19.125926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:19.126417 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:19.126850 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:19.127549 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:19.127972 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:19.128391 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:19.157176 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:17:19.251842 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1f91a538-4c00-4411-9b1f-48f3e894a08b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 204 len: 0 microversion: 2.1 time: 0.142185 Sep 11 15:17:19.253295 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 245/496] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:17:19 2022] DELETE /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:17:19.262499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:19.263132 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:19.270212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:19.270604 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:19.271046 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:19.271776 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:19.272239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:19.272659 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:19.460312 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:19.460835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:19.461577 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:19.468462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:19.468955 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:19.469455 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:19.469650 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-560e54b2-7462-43f4-b156-fd432bdfe8e6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1681 microversion: 2.1 time: 0.211057 Sep 11 15:17:19.470229 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:19.470394 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 252/497] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:19 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:17:19.470734 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:19.471194 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:19.507884 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:19.508813 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:19.509268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:19.509731 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lazy-loading 'fault' on Instance uuid a683d2f3-d434-4377-80fa-7d16bd4d7331 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:17:19.559640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:19.568836 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-209e3d26-e0cb-41a7-bfd2-39aa800fb6ed tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1308 microversion: 2.1 time: 0.112268 Sep 11 15:17:19.569466 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 246/498] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:19 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:20.493724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:20.494712 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:20.502117 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:20.502608 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:20.503037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:20.503743 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:20.504183 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:20.504666 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:20.592646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:20.593418 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:20.600556 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:20.601207 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:20.601670 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:20.602451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:20.602971 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:20.603394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:20.649565 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:20.650059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:20.650533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:20.651287 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lazy-loading 'fault' on Instance uuid a683d2f3-d434-4377-80fa-7d16bd4d7331 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:17:20.886851 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0292da3873ef419097717fd11337a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7984f5434f42098fb127572b6d1e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:20.898785 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9d7908f9-f83e-4e77-b219-8e442f70f0d0 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 200 len: 1308 microversion: 2.1 time: 0.309978 Sep 11 15:17:20.899585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 247/499] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:20 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:20.919180 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:20.927701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ce75cfe9-9cbf-40be-a5bd-154f3f5cca2f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1681 microversion: 2.1 time: 0.437959 Sep 11 15:17:20.928532 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 253/500] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:20 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1681 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:21.927792 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:21.930283 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] [instance: a683d2f3-d434-4377-80fa-7d16bd4d7331] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:21.942628 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:21.943534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:21.944431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:21.946792 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:21.946792 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:21.957303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:21.959689 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:21.960480 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:21.973187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:21.975801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:21.976420 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:21.977722 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:21.978330 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:21.979238 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:21.992951 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] HTTP exception thrown: Instance a683d2f3-d434-4377-80fa-7d16bd4d7331 could not be found. Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Request method failure captured: Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 HTTP/1.1 Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfuD1rqsJhXgzOuwkVbESYdm9wioEgliutezwAoGI4RGY4L3vjJ6OOXL9uj6su56DYpE6-bqh7OlArppZdXzzft6FJuLxJusybbhURK6NwjjvT8CWYuPaHvoqsnXSfMgapkdOJlVhQDGXzJ_nvEcuFFt1Bx7hx2D0SnhKmRRr2ssAhM Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: fd7984f5434f42098fb127572b6d1e0c Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotTestJSON-989814129 Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:17:21.995968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd7984f5434f42098fb127572b6d1e0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd7984f5434f42098fb127572b6d1e0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd7984f5434f42098fb127572b6d1e0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd7984f5434f42098fb127572b6d1e0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotTestJSON-989814129 Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: fd7984f5434f42098fb127572b6d1e0c Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-989814129 Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotTestJSON-989814129-project Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 0292da3873ef419097717fd11337a128 Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotTestJSON-989814129-project Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance a683d2f3-d434-4377-80fa-7d16bd4d7331 could not be found. Sep 11 15:17:21.997576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'a683d2f3-d434-4377-80fa-7d16bd4d7331'} Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a683d2f3-d434-4377-80fa-7d16bd4d7331 could not be found. Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:17:21.998431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a683d2f3-d434-4377-80fa-7d16bd4d7331 could not be found. Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a683d2f3-d434-4377-80fa-7d16bd4d7331 could not be found. Sep 11 15:17:21.999827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:22.002373 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] Returning 404 to user: Instance a683d2f3-d434-4377-80fa-7d16bd4d7331 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:17:22.004133 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-da98a745-b8e1-4c6e-9f06-3723cdc56d59 tempest-VolumesSnapshotTestJSON-989814129 tempest-VolumesSnapshotTestJSON-989814129-project] 10.222.0.44 "GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331" status: 404 len: 111 microversion: 2.1 time: 0.083361 Sep 11 15:17:22.012514 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 248/501] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:21 2022] GET /compute/v2.1/servers/a683d2f3-d434-4377-80fa-7d16bd4d7331 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:17:22.029748 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-602cb2e5-7834-45f7-880d-799c222eff89 req-0f9ce965-e0fe-4321-8c5e-22f578ac9b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13dbbe8-b0bd-4845-9f5a-38f35a2415d1", "name": "network-vif-deleted", "tag": "05549775-1936-4a9a-86d5-fa90ba19ba64"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:22.055278 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-602cb2e5-7834-45f7-880d-799c222eff89 req-0f9ce965-e0fe-4321-8c5e-22f578ac9b7b service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:22.056836 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-602cb2e5-7834-45f7-880d-799c222eff89 req-0f9ce965-e0fe-4321-8c5e-22f578ac9b7b service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:22.058122 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-602cb2e5-7834-45f7-880d-799c222eff89 req-0f9ce965-e0fe-4321-8c5e-22f578ac9b7b service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:22.082239 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-602cb2e5-7834-45f7-880d-799c222eff89 req-0f9ce965-e0fe-4321-8c5e-22f578ac9b7b service nova] Creating event network-vif-deleted:05549775-1936-4a9a-86d5-fa90ba19ba64 for instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 on hv-cinder-83976 Sep 11 15:17:22.099428 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-602cb2e5-7834-45f7-880d-799c222eff89 req-0f9ce965-e0fe-4321-8c5e-22f578ac9b7b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079920 Sep 11 15:17:22.101288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 249/502] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:22.115172 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:22.129232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3edcc637-8d47-4d68-abcf-258fe32fa0f6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 200 len: 1614 microversion: 2.1 time: 0.180164 Sep 11 15:17:22.130384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 254/503] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:21 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 1614 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:23.158914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:23.160015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:23.169221 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:23.169738 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:23.170167 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:23.170994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:23.171505 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:23.172201 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:23.193854 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 HTTP/1.1 Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:17:23.195684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:17:23.196965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'd13dbbe8-b0bd-4845-9f5a-38f35a2415d1'} Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:17:23.197960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:17:23.199099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:23.200120 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:17:23.200120 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cc7a95e2-3904-458c-ad50-2409da2665ab tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 404 len: 111 microversion: 2.1 time: 0.046571 Sep 11 15:17:23.200120 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 250/504] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:23 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:17:23.209648 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8cfc5ccd-88bc-4c0b-b7f3-b9d4e227547d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '.version_select at 0x7f393807e550>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:23.233711 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8cfc5ccd-88bc-4c0b-b7f3-b9d4e227547d tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615983858" status: 202 len: 0 microversion: 2.1 time: 0.027905 Sep 11 15:17:23.234336 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 255/505] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 15:17:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615983858 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:17:24.052210 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-409ebe12-f46e-4a20-af05-7ecfbac3d6f4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: .version_select at 0x7f3933ff7b80>, body: {"keypair": {"name": "tempest-keypair-791036522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWaL8bImLcXUU0Dxcbwbu/QdxfR0KaTZyLm3I0XQU0YWMsmVmdBgC9aiaBxDEG8saS72/nn1dL1Xl1UUj2XVR4ehlD9Gjh3WQJK3IZ7xYLqoUd2lj2E9yygf5kcsNdojw=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:24.069502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-409ebe12-f46e-4a20-af05-7ecfbac3d6f4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:17:24.074596 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-409ebe12-f46e-4a20-af05-7ecfbac3d6f4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for user c44105f2d90e469fb03f311a4cf1476f and project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:17:24.099825 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-409ebe12-f46e-4a20-af05-7ecfbac3d6f4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051613 Sep 11 15:17:24.100445 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 251/506] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:17:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:17:25.504274 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-60667868", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc5581c2-ebe9-4dd1-accb-09df241979bd"}], "security_groups": [{"name": "tempest-securitygroup--60927097"}], "key_name": "tempest-keypair-791036522", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:25.618155 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] validate_networks() for [('fc5581c2-ebe9-4dd1-accb-09df241979bd', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:17:25.689200 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:25.689754 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:25.697314 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:25.697808 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:25.698265 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:25.699024 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:25.699904 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:25.699904 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:25.793817 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lazy-loading 'services' on Instance uuid cae96dd1-992b-4b45-b780-95ee7a2a4d0f {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:17:25.872557 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-374ee00d-2a30-4054-ab34-3cb3cee51160 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments/cb61490b-897c-4500-a596-f3e8aa91a926" status: 202 len: 0 microversion: 2.1 time: 0.188647 Sep 11 15:17:25.873390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 252/507] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:17:25 2022] DELETE /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments/cb61490b-897c-4500-a596-f3e8aa91a926 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:17:25.884954 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-394c0ca9-a8db-49a0-9c27-f2a21c45b788 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:25.887379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-394c0ca9-a8db-49a0-9c27-f2a21c45b788 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:25.904762 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-394c0ca9-a8db-49a0-9c27-f2a21c45b788 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:25.905522 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-394c0ca9-a8db-49a0-9c27-f2a21c45b788 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:25.905994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-394c0ca9-a8db-49a0-9c27-f2a21c45b788 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:25.906868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-394c0ca9-a8db-49a0-9c27-f2a21c45b788 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:25.907323 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-394c0ca9-a8db-49a0-9c27-f2a21c45b788 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:25.907912 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-394c0ca9-a8db-49a0-9c27-f2a21c45b788 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:25.926673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:25.944773 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-394c0ca9-a8db-49a0-9c27-f2a21c45b788 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065817 Sep 11 15:17:25.945592 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 253/508] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:17:25 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:26.036036 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:17:26.036455 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:17:26.036927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:17:26.037360 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:17:26.037806 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:17:26.047325 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:26.047806 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:26.048235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:26.048957 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:26.049440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:26.049853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:26.068326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:17:26.072568 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Getting quotas for user c44105f2d90e469fb03f311a4cf1476f and project c0693786c6694f9e8a8bb8bec8fba0b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:17:26.084745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:17:26.087163 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:17:26.136370 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-653f78e8-acd2-4b7d-a9c0-d90cfe4cad84 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.637699 Sep 11 15:17:26.137221 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 256/509] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:17:25 2022] POST /compute/v2.1/servers => generated 400 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:17:26.152739 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-71eb82dd-18dd-4efa-bd61-462783701f7a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:26.153397 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-71eb82dd-18dd-4efa-bd61-462783701f7a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:26.210220 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-71eb82dd-18dd-4efa-bd61-462783701f7a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:26.217792 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-71eb82dd-18dd-4efa-bd61-462783701f7a tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1239 microversion: 2.1 time: 0.070054 Sep 11 15:17:26.218235 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 254/510] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:26 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:26.958248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e8d05b73-80f1-46d4-9aa2-9aa066c21b0d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:26.960913 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e8d05b73-80f1-46d4-9aa2-9aa066c21b0d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:26.967742 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d05b73-80f1-46d4-9aa2-9aa066c21b0d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:26.968226 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d05b73-80f1-46d4-9aa2-9aa066c21b0d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:26.968651 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d05b73-80f1-46d4-9aa2-9aa066c21b0d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:26.969349 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d05b73-80f1-46d4-9aa2-9aa066c21b0d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:26.969976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d05b73-80f1-46d4-9aa2-9aa066c21b0d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:26.970406 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d05b73-80f1-46d4-9aa2-9aa066c21b0d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:27.001634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e8d05b73-80f1-46d4-9aa2-9aa066c21b0d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047993 Sep 11 15:17:27.002228 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 257/511] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:17:26 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:27.241953 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:27.242830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:27.257013 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:27.257759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:27.258191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:27.259063 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:27.259601 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:27.260620 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:27.367451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:27.389454 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3b555f04-8dec-4499-9e40-ad2c7ca59ceb tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1291 microversion: 2.1 time: 0.151532 Sep 11 15:17:27.405305 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 255/512] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:27 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1291 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:28.023375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8dbe130b-0a20-4e0e-8d6d-3de903c07231 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:28.025606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8dbe130b-0a20-4e0e-8d6d-3de903c07231 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:28.032300 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8dbe130b-0a20-4e0e-8d6d-3de903c07231 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:28.032789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8dbe130b-0a20-4e0e-8d6d-3de903c07231 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:28.033252 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8dbe130b-0a20-4e0e-8d6d-3de903c07231 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:28.033964 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8dbe130b-0a20-4e0e-8d6d-3de903c07231 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:28.034413 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8dbe130b-0a20-4e0e-8d6d-3de903c07231 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:28.034826 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8dbe130b-0a20-4e0e-8d6d-3de903c07231 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:28.068855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8dbe130b-0a20-4e0e-8d6d-3de903c07231 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049433 Sep 11 15:17:28.069545 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 258/513] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:17:28 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 15:17:28.156827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:28.157604 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:28.163896 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:28.164305 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:28.164732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:28.165450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:28.165941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:28.166361 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:28.193767 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:17:28.284199 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a0519b2c-fd0b-42d3-9e3c-a1906e67fd3e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 204 len: 0 microversion: 2.1 time: 0.130882 Sep 11 15:17:28.285492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 256/514] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:17:28 2022] DELETE /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:17:28.294058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:28.294669 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:28.300952 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:28.301475 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:28.301903 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:28.302599 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:28.303042 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:28.303459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:28.436347 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:28.444680 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:28.458402 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:28.458903 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:28.459496 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:28.460272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:28.460729 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:28.461164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:28.472826 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:28.482385 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-27a6b70b-d86b-4d03-a329-82725f491be5 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1692 microversion: 2.1 time: 0.192526 Sep 11 15:17:28.483579 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 259/515] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:28 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:28.661473 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:28.679293 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fcd062bc-79fe-40f4-8440-44a995aa9084 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.247917 Sep 11 15:17:28.680360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 257/516] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:28 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:29.511524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:29.512171 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:29.519281 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:29.519745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:29.520182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:29.520882 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:29.521367 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:29.521795 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:29.670476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:29.683630 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6767e853-301a-4ca6-8fbb-a0bf76c4c489 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1692 microversion: 2.1 time: 0.175701 Sep 11 15:17:29.684614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 260/517] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:29 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:29.705940 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:29.708468 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:29.716726 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:29.717619 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:29.718259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:29.719548 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:29.720169 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:29.720856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:29.876646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:29.885990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f1c2bb8e-8bd7-4452-a278-3b9ed2c8f07e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.185745 Sep 11 15:17:29.886437 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 258/518] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:29 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:17:30.719365 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:30.719933 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:30.726820 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:30.727553 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:30.727989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:30.728840 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:30.729335 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:30.729754 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:30.875025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:30.883200 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-60c21d52-2bb8-4c51-a045-b21fb2cc05cb tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1692 microversion: 2.1 time: 0.167790 Sep 11 15:17:30.883788 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 261/519] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:30 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:30.922913 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:30.923713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:30.930597 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:30.931095 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:30.931614 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:30.932310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:30.932796 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:30.933242 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:31.081548 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:31.091444 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4658d33c-7404-4943-90ef-a3b6e65fa806 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.171585 Sep 11 15:17:31.091930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 259/520] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:30 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:31.906978 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:31.907702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:31.914664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:31.915158 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:31.915601 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:31.916348 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:31.916786 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:31.917238 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:32.097269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:32.100916 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:32.109620 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0bf2c736-6248-4f59-a2f8-433500b08500 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1692 microversion: 2.1 time: 0.206703 Sep 11 15:17:32.110316 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 262/521] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:31 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1692 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:32.119562 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:32.120324 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:32.128193 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:32.128763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:32.129328 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:32.130156 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:32.130672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:32.131157 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:32.135130 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-d68bb95f-6786-433c-ae1c-204e81209178 req-815dd9ee-be65-4cb6-beb9-c42b9713d8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a55130-37ac-4875-9029-bedc43fc2149", "tag": "7104d628-55df-402f-9a4c-e4007e2130f6"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:32.153644 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d68bb95f-6786-433c-ae1c-204e81209178 req-815dd9ee-be65-4cb6-beb9-c42b9713d8c8 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:32.154614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d68bb95f-6786-433c-ae1c-204e81209178 req-815dd9ee-be65-4cb6-beb9-c42b9713d8c8 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:32.156290 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d68bb95f-6786-433c-ae1c-204e81209178 req-815dd9ee-be65-4cb6-beb9-c42b9713d8c8 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:32.186539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-d68bb95f-6786-433c-ae1c-204e81209178 req-815dd9ee-be65-4cb6-beb9-c42b9713d8c8 service nova] Creating event network-changed:7104d628-55df-402f-9a4c-e4007e2130f6 for instance 88a55130-37ac-4875-9029-bedc43fc2149 on hv-cinder-83976 Sep 11 15:17:32.208511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-d68bb95f-6786-433c-ae1c-204e81209178 req-815dd9ee-be65-4cb6-beb9-c42b9713d8c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073624 Sep 11 15:17:32.208511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 263/522] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:32.288506 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:32.297554 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d76b8f3e-db26-4e65-bfec-99daf7dd057e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.182883 Sep 11 15:17:32.298159 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 260/523] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:32 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:17:33.135071 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:33.135744 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:33.143222 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:33.143707 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:33.144120 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:33.144840 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:33.145332 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:33.145747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:33.295154 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:33.303922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-571528d4-ade2-4ba7-852c-369ae2b678b4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1692 microversion: 2.1 time: 0.173693 Sep 11 15:17:33.304526 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 264/524] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:33 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:33.323232 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:33.323923 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:33.331241 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:33.331727 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:33.332164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:33.332874 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:33.333368 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:33.333780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:33.486003 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:33.496929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e8d307c9-922b-4011-aced-54e7dd0f0fa4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.177996 Sep 11 15:17:33.498004 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 261/525] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:33 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:34.329515 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:34.330261 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:34.339674 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:34.340148 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:34.340584 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:34.341350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:34.341805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:34.342521 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:34.501967 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:34.511621 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-42fe04dc-6ce2-4fbe-89c1-2679f47e8b70 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1692 microversion: 2.1 time: 0.187024 Sep 11 15:17:34.512364 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 265/526] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:34 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1692 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:34.520368 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:34.521061 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:34.528882 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:34.529662 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:34.530299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:34.531038 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:34.531484 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:34.531895 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:34.698467 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:34.707169 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-73c2ddba-4bb5-4927-8c2e-afb1ef28203f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.190755 Sep 11 15:17:34.707752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 262/527] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:34 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:17:35.541937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:35.542639 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:35.551792 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:35.552610 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:35.553247 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:35.554231 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:35.555280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:35.556346 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:35.680950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:35.689663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1f5547d7-8994-4f3c-a3df-d76869eadf3b tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1624 microversion: 2.1 time: 0.152653 Sep 11 15:17:35.690318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 266/528] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:35 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1624 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:35.744252 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:35.745155 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:35.754255 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:35.754876 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:35.755573 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:35.756821 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:35.757763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:35.758361 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:36.017358 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:36.054265 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ede95bf7-5b5f-4675-89b2-be637f1afded tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.317989 Sep 11 15:17:36.054897 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 263/529] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:35 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:36.255959 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-fe4293d3-340d-4f75-bd70-f4214741dc31 req-70abadda-6df5-4745-b2b6-c22cd8465757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae96dd1-992b-4b45-b780-95ee7a2a4d0f", "name": "network-vif-deleted", "tag": "0d49c605-6c2c-4c31-80df-739077e3707e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:36.262540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:36.263714 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:36.269855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-fe4293d3-340d-4f75-bd70-f4214741dc31 req-70abadda-6df5-4745-b2b6-c22cd8465757 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:36.270263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-fe4293d3-340d-4f75-bd70-f4214741dc31 req-70abadda-6df5-4745-b2b6-c22cd8465757 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:36.270782 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-fe4293d3-340d-4f75-bd70-f4214741dc31 req-70abadda-6df5-4745-b2b6-c22cd8465757 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:36.285049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-fe4293d3-340d-4f75-bd70-f4214741dc31 req-70abadda-6df5-4745-b2b6-c22cd8465757 service nova] Creating event network-vif-deleted:0d49c605-6c2c-4c31-80df-739077e3707e for instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f on hv-cinder-83976 Sep 11 15:17:36.291426 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-fe4293d3-340d-4f75-bd70-f4214741dc31 req-70abadda-6df5-4745-b2b6-c22cd8465757 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039136 Sep 11 15:17:36.292193 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 267/530] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:36.714446 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:36.715307 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:36.718826 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:36.728005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:36.728891 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:36.729677 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:36.730951 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:36.731757 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:36.732493 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:36.815570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:36.827136 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2fbde44a-1b3c-4daf-94f3-923ac203cee4 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 200 len: 1624 microversion: 2.1 time: 0.117056 Sep 11 15:17:36.828303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 264/531] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:36 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 1624 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:37.108763 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:37.108763 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:37.124845 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:37.126157 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:37.127009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:37.128456 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:37.129689 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:37.130918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:37.322448 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:37.332033 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9a13670d-465b-4016-b8c4-40976f70620c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.242336 Sep 11 15:17:37.345340 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 268/532] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:37 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:37.866521 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:37.867457 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: cae96dd1-992b-4b45-b780-95ee7a2a4d0f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:37.878708 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:37.879539 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:37.880274 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:37.881497 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:37.882266 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:37.882991 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:37.903008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] HTTP exception thrown: Instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f could not be found. Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Request method failure captured: Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f HTTP/1.1 Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrnpbJ4tYApu2HZiYVfH1ap7MKgo-OUf63y1EMdUS7c2C0Cyk0CXffOTT7TvUzCOKJeukeE8FSdqt1DqlhZSFyHN8iGlJfL7-w16CPok_KAr5O78YL_Ns6MtrmdddYXVleAKY6YUhYcUGweuANbGmFHEFc1dEIquEj-BU1TXuggVp0 Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:17:37.905741 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7933806a47704d2d867be7312890b538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7933806a47704d2d867be7312890b538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 2bd47bf9aa4142b1b7ec8d02e8661578 Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f could not be found. Sep 11 15:17:37.908273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'cae96dd1-992b-4b45-b780-95ee7a2a4d0f'} Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f could not be found. Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:17:37.909824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f could not be found. Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f could not be found. Sep 11 15:17:37.912683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:37.915268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Returning 404 to user: Instance cae96dd1-992b-4b45-b780-95ee7a2a4d0f could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:17:37.915268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5c98277e-b129-494b-ae95-8d50d2ac797c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f" status: 404 len: 111 microversion: 2.1 time: 0.047171 Sep 11 15:17:37.915268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 265/533] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:37 2022] GET /compute/v2.1/servers/cae96dd1-992b-4b45-b780-95ee7a2a4d0f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:17:37.917523 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-21ad152b-dba2-4c0d-bad9-424bbb8d73ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '.version_select at 0x7f3938085f70>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:37.939044 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-21ad152b-dba2-4c0d-bad9-424bbb8d73ea tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952220402" status: 202 len: 0 microversion: 2.1 time: 0.025520 Sep 11 15:17:37.939646 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 269/534] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 15:17:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952220402 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:17:38.462645 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:38.463576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:38.472067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:38.473186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:38.473771 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:38.474971 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:38.475730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:38.476497 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:38.755691 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:38.767931 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7994a620-9a4e-442c-af07-d33589fcca1e tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.396297 Sep 11 15:17:38.768915 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 266/535] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:38 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:39.795828 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:39.796498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:39.803803 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:39.804299 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:39.804753 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:39.805532 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:39.805988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:39.806407 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:39.980724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:39.990452 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7a10f864-5bda-477a-93c4-13af3096a978 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.200396 Sep 11 15:17:39.991057 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 270/536] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:39 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:41.025416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:41.026215 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:41.033512 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:41.034754 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:41.035255 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:41.035992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:41.036448 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:41.037109 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:41.269471 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:41.271347 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:41.274908 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:41.282719 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:41.284876 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4efefafa-f646-480c-b3a7-a9781e555e5c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.263382 Sep 11 15:17:41.285101 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:41.285632 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 267/537] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:41 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:41.290542 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:41.292332 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:41.293341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:41.294280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:41.328936 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:17:41.425426 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-65c76487-be97-4659-9690-4820cf806d8c tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 204 len: 0 microversion: 2.1 time: 0.162162 Sep 11 15:17:41.426520 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 271/538] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:17:41 2022] DELETE /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 15:17:41.437656 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:41.438501 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:41.446139 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:41.446668 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:41.447214 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:41.447994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:41.448491 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:41.448985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:41.593463 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:41.602086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f5bf6cd3-42df-4489-96aa-68f51d8ed24d tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1507 microversion: 2.1 time: 0.169685 Sep 11 15:17:41.602685 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 268/539] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:41 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:42.327492 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:42.328229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:42.335750 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:42.336237 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:42.336670 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:42.337465 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:42.337915 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:42.338329 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:42.492463 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-6b940c21-ea15-40bd-b0a4-d0ae066917b2 req-3effcb36-c88f-41c5-9e0e-9b31288383c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a55130-37ac-4875-9029-bedc43fc2149", "name": "network-vif-plugged", "status": "completed", "tag": "7104d628-55df-402f-9a4c-e4007e2130f6"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:42.505336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:42.511704 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:42.514221 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-6b940c21-ea15-40bd-b0a4-d0ae066917b2 req-3effcb36-c88f-41c5-9e0e-9b31288383c1 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:42.515406 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-6b940c21-ea15-40bd-b0a4-d0ae066917b2 req-3effcb36-c88f-41c5-9e0e-9b31288383c1 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:42.516195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-6b940c21-ea15-40bd-b0a4-d0ae066917b2 req-3effcb36-c88f-41c5-9e0e-9b31288383c1 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:42.522399 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f54c94cb-f51d-4a8a-979e-48b16d893f13 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.204188 Sep 11 15:17:42.524279 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 272/540] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:42 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:42.543585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-6b940c21-ea15-40bd-b0a4-d0ae066917b2 req-3effcb36-c88f-41c5-9e0e-9b31288383c1 service nova] Creating event network-vif-plugged:7104d628-55df-402f-9a4c-e4007e2130f6 for instance 88a55130-37ac-4875-9029-bedc43fc2149 on hv-cinder-83976 Sep 11 15:17:42.552991 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-6b940c21-ea15-40bd-b0a4-d0ae066917b2 req-3effcb36-c88f-41c5-9e0e-9b31288383c1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068590 Sep 11 15:17:42.554172 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 269/541] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:42.626569 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:42.627187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:42.634154 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:42.634656 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:42.635092 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:42.635842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:42.636292 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:42.636721 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:42.802979 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:42.813308 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-98042177-810b-4dea-ad95-f73ce407ff33 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1507 microversion: 2.1 time: 0.190816 Sep 11 15:17:42.813995 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 273/542] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:42 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:43.548379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:43.549180 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:43.556538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:43.557028 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:43.557562 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:43.558271 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:43.558723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:43.559188 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:43.724502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:43.728276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:43.734427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2cd4b2cd-07ba-49b9-a341-b8eb08c43a02 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.191792 Sep 11 15:17:43.735288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 270/543] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:43 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:17:43.848642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:43.849701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:43.857476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:43.857965 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:43.858395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:43.859106 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:43.859560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:43.859981 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:43.999734 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:44.008245 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a5f5fd2d-ea72-4d03-83ea-09037523f7b0 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1507 microversion: 2.1 time: 0.163847 Sep 11 15:17:44.008841 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 274/544] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:43 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:44.605812 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-d6c142bf-baab-4610-8f5d-ab95e52de9a4 req-2a42f17f-0d78-411a-904e-a31ba68e91ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd773d7-015b-48eb-8a9d-d2616f33eef4", "name": "network-vif-deleted", "tag": "62273584-e0b8-45ee-b16c-b73368a64b8f"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:44.618287 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d6c142bf-baab-4610-8f5d-ab95e52de9a4 req-2a42f17f-0d78-411a-904e-a31ba68e91ed service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:44.619326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d6c142bf-baab-4610-8f5d-ab95e52de9a4 req-2a42f17f-0d78-411a-904e-a31ba68e91ed service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:44.619817 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d6c142bf-baab-4610-8f5d-ab95e52de9a4 req-2a42f17f-0d78-411a-904e-a31ba68e91ed service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:44.634257 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-d6c142bf-baab-4610-8f5d-ab95e52de9a4 req-2a42f17f-0d78-411a-904e-a31ba68e91ed service nova] Creating event network-vif-deleted:62273584-e0b8-45ee-b16c-b73368a64b8f for instance dcd773d7-015b-48eb-8a9d-d2616f33eef4 on hv-cinder-83976 Sep 11 15:17:44.640937 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-d6c142bf-baab-4610-8f5d-ab95e52de9a4 req-2a42f17f-0d78-411a-904e-a31ba68e91ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 Sep 11 15:17:44.642307 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 271/545] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:44.759422 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:44.759973 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:44.767469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:44.767980 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:44.768415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:44.769127 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:44.769794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:44.770209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:44.948729 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:44.958457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-29811737-3803-4ab7-8775-5d99629c79c9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1363 microversion: 2.1 time: 0.203632 Sep 11 15:17:44.959121 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 275/546] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:44 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:45.038535 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:45.039340 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:45.046371 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:45.047031 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:45.047529 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:45.048299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:45.048809 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:45.049321 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:45.086130 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:45.086884 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:45.087389 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:45.087946 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lazy-loading 'fault' on Instance uuid dcd773d7-015b-48eb-8a9d-d2616f33eef4 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:17:45.136833 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:45.145534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-30ef9ff1-9f83-44d8-9514-8fe10497a536 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 200 len: 1311 microversion: 2.1 time: 0.111427 Sep 11 15:17:45.146321 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 272/547] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:45 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:45.992767 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:45.994246 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:45.999021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:46.004128 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.004858 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.005322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.006353 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.006990 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.007747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.169804 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:46.170878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: dcd773d7-015b-48eb-8a9d-d2616f33eef4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:46.182363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.183222 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.183930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.185445 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.186965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.193315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:46.197709 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.208361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c13b73ea-5a01-421e-a64c-92f79dce93ac tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1553 microversion: 2.1 time: 0.222212 Sep 11 15:17:46.209900 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 276/548] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:45 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:46.253333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] HTTP exception thrown: Instance dcd773d7-015b-48eb-8a9d-d2616f33eef4 could not be found. Sep 11 15:17:46.261260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f29e2e5f-6c63-4351-a998-c3e645dec936 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Request method failure captured: Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 HTTP/1.1 Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrnpbJ4tYApu2HZiYVfH1ap7MKgo-OUf63y1EMdUS7c2C0Cyk0CXffOTT7TvUzCOKJeukeE8FSdqt1DqlhZSFyHN8iGlJfL7-w16CPok_KAr5O78YL_Ns6MtrmdddYXVleAKY6YUhYcUGweuANbGmFHEFc1dEIquEj-BU1TXuggVp0 Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:17:46.261431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7933806a47704d2d867be7312890b538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7933806a47704d2d867be7312890b538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 2bd47bf9aa4142b1b7ec8d02e8661578 Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance dcd773d7-015b-48eb-8a9d-d2616f33eef4 could not be found. Sep 11 15:17:46.263203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'dcd773d7-015b-48eb-8a9d-d2616f33eef4'} Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd773d7-015b-48eb-8a9d-d2616f33eef4 could not be found. Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:17:46.264381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd773d7-015b-48eb-8a9d-d2616f33eef4 could not be found. Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd773d7-015b-48eb-8a9d-d2616f33eef4 could not be found. Sep 11 15:17:46.269959 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:17:46.271393 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f29e2e5f-6c63-4351-a998-c3e645dec936 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:46.271492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Returning 404 to user: Instance dcd773d7-015b-48eb-8a9d-d2616f33eef4 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:17:46.271492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4e22a233-c941-44a8-aaf2-9dbd19c95faa tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4" status: 404 len: 111 microversion: 2.1 time: 0.096739 Sep 11 15:17:46.271492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 273/549] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:46 2022] GET /compute/v2.1/servers/dcd773d7-015b-48eb-8a9d-d2616f33eef4 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 15:17:46.272640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:46.273161 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:46.280152 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.280641 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.281070 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.282425 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.282425 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.282728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.299775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f29e2e5f-6c63-4351-a998-c3e645dec936 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.302620 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f29e2e5f-6c63-4351-a998-c3e645dec936 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.304045 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f29e2e5f-6c63-4351-a998-c3e645dec936 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.306409 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f29e2e5f-6c63-4351-a998-c3e645dec936 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.307739 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f29e2e5f-6c63-4351-a998-c3e645dec936 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.308979 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f29e2e5f-6c63-4351-a998-c3e645dec936 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.316168 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:17:46.442748 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-425aa309-4d8d-4d47-847f-bf3475cad982 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 204 len: 0 microversion: 2.1 time: 0.173907 Sep 11 15:17:46.443399 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 274/550] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:17:46 2022] DELETE /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:17:46.459815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f29e2e5f-6c63-4351-a998-c3e645dec936 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210060 Sep 11 15:17:46.461595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 277/551] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 15:17:46 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:17:46.471259 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:46.472694 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:46.484259 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.485380 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.486299 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.488920 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.489855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.490685 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.561115 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d85da7e1-ab19-4d5b-afeb-940bbd3a0efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:46.561927 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d85da7e1-ab19-4d5b-afeb-940bbd3a0efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:46.571162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85da7e1-ab19-4d5b-afeb-940bbd3a0efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.571739 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85da7e1-ab19-4d5b-afeb-940bbd3a0efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.572750 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85da7e1-ab19-4d5b-afeb-940bbd3a0efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.573807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85da7e1-ab19-4d5b-afeb-940bbd3a0efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:46.574572 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85da7e1-ab19-4d5b-afeb-940bbd3a0efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:46.574999 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d85da7e1-ab19-4d5b-afeb-940bbd3a0efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:46.605644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d85da7e1-ab19-4d5b-afeb-940bbd3a0efa tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/ips" status: 200 len: 152 microversion: 2.20 time: 0.160879 Sep 11 15:17:46.613388 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 275/552] 10.222.0.44 () {60 vars in 1289 bytes} [Sun Sep 11 15:17:46 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/ips => generated 152 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 15:17:47.075082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:47.083937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5316539f-d803-484d-a538-a468aa4ce54e tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.620447 Sep 11 15:17:47.097950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 278/553] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:46 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:47.795190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-0997ff7b-24e3-49c7-abee-af76c2b3378b req-b0398461-2fe2-48f3-9a75-c5fa64d06a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a55130-37ac-4875-9029-bedc43fc2149", "tag": "7104d628-55df-402f-9a4c-e4007e2130f6"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:47.805365 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0997ff7b-24e3-49c7-abee-af76c2b3378b req-b0398461-2fe2-48f3-9a75-c5fa64d06a4d service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:47.805857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0997ff7b-24e3-49c7-abee-af76c2b3378b req-b0398461-2fe2-48f3-9a75-c5fa64d06a4d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:47.806424 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0997ff7b-24e3-49c7-abee-af76c2b3378b req-b0398461-2fe2-48f3-9a75-c5fa64d06a4d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:47.819042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-0997ff7b-24e3-49c7-abee-af76c2b3378b req-b0398461-2fe2-48f3-9a75-c5fa64d06a4d service nova] Creating event network-changed:7104d628-55df-402f-9a4c-e4007e2130f6 for instance 88a55130-37ac-4875-9029-bedc43fc2149 on hv-cinder-83976 Sep 11 15:17:47.824169 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-0997ff7b-24e3-49c7-abee-af76c2b3378b req-b0398461-2fe2-48f3-9a75-c5fa64d06a4d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032861 Sep 11 15:17:47.824870 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 276/554] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:48.108187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:48.109025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:48.115768 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:48.116285 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:48.116720 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:48.117464 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:48.117921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:48.118346 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:48.284706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:48.294641 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2dbc3d4c-13da-47cc-9803-17b0819d6589 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.190269 Sep 11 15:17:48.295578 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 279/555] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:48 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:48.578838 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:48.579801 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:48.586341 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:48.586831 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:48.587303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:48.588021 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:48.588463 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:48.588878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:48.615353 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lazy-loading 'flavor' on Instance uuid d3ed2d84-4e3f-48cd-98a1-00bc736956fa {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:17:48.829983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-258c68af-5db6-491b-8eb4-89d54a2a2b04 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/action" status: 202 len: 0 microversion: 2.20 time: 0.255256 Sep 11 15:17:48.831014 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 277/556] 10.222.0.44 () {62 vars in 1319 bytes} [Sun Sep 11 15:17:48 2022] POST /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:17:48.840951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:48.841593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:48.848362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:48.848885 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:48.849366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:48.850092 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:48.850543 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:48.851181 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:48.871866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:17:49.030725 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:49.040708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:49.042437 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:49.043734 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-17d430dc-a415-4d94-8d14-84831812bb75 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.208212 Sep 11 15:17:49.044392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 280/557] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:48 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:17:49.321042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:49.321769 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:49.328539 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:49.329452 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:49.329958 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:49.330730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:49.331256 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:49.331772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:49.493079 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:49.506219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-aa371a27-ac87-44d8-ba40-925960078297 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1523 microversion: 2.1 time: 0.189666 Sep 11 15:17:49.507124 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 278/558] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:49 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:50.071047 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:50.071710 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:50.078588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:50.079072 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:50.079494 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:50.080439 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:50.080882 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:50.081337 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:50.239039 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:50.264507 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:50.266151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:50.268058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1ec4e0be-3d9a-43ae-b5c1-d834d267aeca tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.202542 Sep 11 15:17:50.268657 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 281/559] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:50 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:17:50.324370 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-dd4a4f29-2f7a-41ca-b28a-e3c2a16a0af4 req-b097ade8-a8d2-4605-8c12-6d8b11131272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d870f595-3d29-47d7-b4b4-6d51343a4acf", "name": "network-vif-deleted", "tag": "5c7d6d35-d077-4f1f-a6ce-ab24e1a4b92a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:17:50.341024 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-dd4a4f29-2f7a-41ca-b28a-e3c2a16a0af4 req-b097ade8-a8d2-4605-8c12-6d8b11131272 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:50.341645 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-dd4a4f29-2f7a-41ca-b28a-e3c2a16a0af4 req-b097ade8-a8d2-4605-8c12-6d8b11131272 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:50.342133 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-dd4a4f29-2f7a-41ca-b28a-e3c2a16a0af4 req-b097ade8-a8d2-4605-8c12-6d8b11131272 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:50.354519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-dd4a4f29-2f7a-41ca-b28a-e3c2a16a0af4 req-b097ade8-a8d2-4605-8c12-6d8b11131272 service nova] Creating event network-vif-deleted:5c7d6d35-d077-4f1f-a6ce-ab24e1a4b92a for instance d870f595-3d29-47d7-b4b4-6d51343a4acf on hv-cinder-83976 Sep 11 15:17:50.359688 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-dd4a4f29-2f7a-41ca-b28a-e3c2a16a0af4 req-b097ade8-a8d2-4605-8c12-6d8b11131272 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046014 Sep 11 15:17:50.360544 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 279/560] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:17:50.532853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:50.534007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:50.544876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:50.545453 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:50.545902 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:50.546676 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:50.547452 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:50.547873 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:50.583079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:50.583548 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:50.583974 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:50.584414 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lazy-loading 'fault' on Instance uuid d870f595-3d29-47d7-b4b4-6d51343a4acf {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:17:50.633495 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd47bf9aa4142b1b7ec8d02e8661578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7933806a47704d2d867be7312890b538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:50.642094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cb000781-1d94-48d1-bd00-c08e1c6af245 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 200 len: 1312 microversion: 2.1 time: 0.114936 Sep 11 15:17:50.642805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 282/561] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:50 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:17:51.295063 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:51.295928 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:51.303395 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:51.303874 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:51.304302 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:51.305000 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:51.305479 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:51.306276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:51.448730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:51.459030 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:51.460740 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:51.462367 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4b2a6713-3e0a-47b8-b57f-7f5f2c02fceb tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.171702 Sep 11 15:17:51.462941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 280/562] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:51 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:17:51.667552 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:51.668114 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] [instance: d870f595-3d29-47d7-b4b4-6d51343a4acf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:51.675357 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:51.675840 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:51.676249 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:51.677002 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:51.677436 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:51.677874 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:51.693947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] HTTP exception thrown: Instance d870f595-3d29-47d7-b4b4-6d51343a4acf could not be found. Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Request method failure captured: Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf HTTP/1.1 Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrnpbJ4tYApu2HZiYVfH1ap7MKgo-OUf63y1EMdUS7c2C0Cyk0CXffOTT7TvUzCOKJeukeE8FSdqt1DqlhZSFyHN8iGlJfL7-w16CPok_KAr5O78YL_Ns6MtrmdddYXVleAKY6YUhYcUGweuANbGmFHEFc1dEIquEj-BU1TXuggVp0 Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:17:51.695632 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7933806a47704d2d867be7312890b538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7933806a47704d2d867be7312890b538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7933806a47704d2d867be7312890b538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 7933806a47704d2d867be7312890b538 Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980294534 Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 2bd47bf9aa4142b1b7ec8d02e8661578 Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980294534-project Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance d870f595-3d29-47d7-b4b4-6d51343a4acf could not be found. Sep 11 15:17:51.697161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'd870f595-3d29-47d7-b4b4-6d51343a4acf'} Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d870f595-3d29-47d7-b4b4-6d51343a4acf could not be found. Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:17:51.698007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d870f595-3d29-47d7-b4b4-6d51343a4acf could not be found. Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d870f595-3d29-47d7-b4b4-6d51343a4acf could not be found. Sep 11 15:17:51.699209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:17:51.700547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] Returning 404 to user: Instance d870f595-3d29-47d7-b4b4-6d51343a4acf could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:17:51.700547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-35fdda16-ff6d-404f-b947-5cec04d78039 tempest-ServerRescueNegativeTestJSON-980294534 tempest-ServerRescueNegativeTestJSON-980294534-project] 10.222.0.44 "GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf" status: 404 len: 111 microversion: 2.1 time: 0.033894 Sep 11 15:17:51.700547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 283/563] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:17:51 2022] GET /compute/v2.1/servers/d870f595-3d29-47d7-b4b4-6d51343a4acf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:17:52.487793 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:52.488506 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:52.495426 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:52.495915 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:52.496352 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:52.497051 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:52.497690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:52.498111 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:52.630706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:52.639597 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:52.641022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:52.642218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-708861b9-0c16-4301-b8fa-666bc3d228ac tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.158465 Sep 11 15:17:52.642772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 281/564] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:52 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:17:53.673619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:53.674919 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:53.686604 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:53.687895 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:53.688894 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:53.690217 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:53.691021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:53.692268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:53.907637 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:53.924798 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:53.928516 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:53.931695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8bc02f5d-fee2-4d2b-80f4-489c63369779 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.266399 Sep 11 15:17:53.951224 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 284/565] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:53 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:17:54.977009 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:54.977901 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:54.985496 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:54.985987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:54.986466 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:54.987157 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:54.988345 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:54.988345 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:55.158447 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:55.174794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:55.176152 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:55.178432 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5a835ce8-3893-4119-8f4a-8cb18ad8638a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.205693 Sep 11 15:17:55.179854 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 282/566] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:54 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:17:56.230240 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:56.230933 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:56.238010 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:56.238522 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:56.238958 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:56.239679 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:56.240130 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:56.240544 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:56.382976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:56.392090 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:56.393601 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:56.395174 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2ce5e106-b004-487e-a2bd-dc443c16cf0a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.169529 Sep 11 15:17:56.395744 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 285/567] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:56 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:17:57.422458 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:57.425255 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:57.432475 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:57.432995 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:57.433438 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:57.434248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:57.434823 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:57.435538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:57.614681 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:57.624195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:57.625958 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:57.627442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5147c9e7-c7d7-4cc1-a4c6-aaa7a64a70e5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.211140 Sep 11 15:17:57.628243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 283/568] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:57 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:17:58.666542 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:58.667142 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:58.674297 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:58.674783 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:58.675281 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:58.676149 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:58.676614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:58.677038 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:58.823071 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:58.831890 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:58.833466 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:17:58.834734 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1a66452e-5492-4c4e-bb75-54ad4bf024d1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.172540 Sep 11 15:17:58.835554 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 286/569] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:58 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:17:59.860093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:17:59.861392 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:17:59.868265 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:59.869013 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:59.869474 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:17:59.870176 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:17:59.870782 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:17:59.871206 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:00.050938 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:00.060109 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:00.061706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:00.062989 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7e6b4bb3-c0f7-480c-b216-d6bf78fdd854 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.206962 Sep 11 15:18:00.063972 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 284/570] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:17:59 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:18:01.088214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:01.088974 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:01.106111 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:01.106953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:01.107616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:01.109329 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:01.110426 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:01.111059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:01.334616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:01.345959 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:01.348150 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:01.355671 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-863db97e-8b0a-495a-8813-2bf56a42592f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.265323 Sep 11 15:18:01.356359 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 287/571] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:01 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:18:01.729903 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e02d94a3-9ff8-4298-a8c1-ed9aabf7ef9c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'create', calling method: .version_select at 0x7f3933f6f820>, body: {"keypair": {"name": "tempest-keypair-1008187726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgdMN2P9XwnvPSerEecSMvNcVZUcqfrIveEDq4aNvCwi1RX/8iJGjwlEPNugb385fVOFJ5zZMMbIXdZkEjEN8KDUjNP40vWG5LDjMDM1UM6DiTjLGDKYEsmF6ocEuUoRQ=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:01.747505 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-e02d94a3-9ff8-4298-a8c1-ed9aabf7ef9c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Getting quotas for project bf1611f722d34ce0b058da277806b326. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:18:01.752167 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-e02d94a3-9ff8-4298-a8c1-ed9aabf7ef9c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Getting quotas for user 948640729c5c4975b3b050129eb63eea and project bf1611f722d34ce0b058da277806b326. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:18:01.783919 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e02d94a3-9ff8-4298-a8c1-ed9aabf7ef9c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.198262 Sep 11 15:18:01.790821 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 285/572] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:18:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:02.392209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:02.393003 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:02.400201 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:02.400697 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:02.401160 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:02.401905 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:02.402361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:02.402777 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:02.595999 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:02.604997 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:02.606458 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:02.607648 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7da2c7c9-01a3-40da-a2b1-e3eba3f2df65 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.219548 Sep 11 15:18:02.608233 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 288/573] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:02 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:03.257994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-114929907", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f33c684-59b7-47cf-8a30-9971261fe11c"}], "security_groups": [{"name": "tempest-securitygroup--1144035701"}], "key_name": "tempest-keypair-1008187726", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:03.379635 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] validate_networks() for [('9f33c684-59b7-47cf-8a30-9971261fe11c', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:18:03.633947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:03.635244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:03.642415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:03.642898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:03.643333 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:03.644049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:03.644499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:03.644917 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:03.876479 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:03.892007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:03.894527 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:03.896704 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a6dcfad2-1e79-42e9-abf6-3146af4e5270 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.266567 Sep 11 15:18:03.897739 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 289/574] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:03 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:03.923576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:18:03.924086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:18:03.924622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:18:03.925097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:18:03.925642 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:18:03.935395 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:03.935879 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:03.936340 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:03.937076 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:03.937569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:03.937992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:03.958107 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Getting quotas for project bf1611f722d34ce0b058da277806b326. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:18:03.963146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Getting quotas for user 948640729c5c4975b3b050129eb63eea and project bf1611f722d34ce0b058da277806b326. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:18:03.976084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:18:03.978580 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:18:04.030889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-94f7eadc-e548-4529-bb6c-7367acf75592 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.781756 Sep 11 15:18:04.031809 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 286/575] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:18:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:18:04.043613 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b53a4aec-6590-485c-ac30-4428e11f3534 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:04.044265 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b53a4aec-6590-485c-ac30-4428e11f3534 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:04.126805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b53a4aec-6590-485c-ac30-4428e11f3534 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:04.136785 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b53a4aec-6590-485c-ac30-4428e11f3534 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1237 microversion: 2.1 time: 0.097088 Sep 11 15:18:04.137406 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 290/576] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:04 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:18:04.923195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:04.924435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:04.931160 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:04.932183 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:04.932547 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:04.933440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:04.933896 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:04.934309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:05.121903 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:05.141660 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:05.143860 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:05.145191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c2f640be-c5d1-43d7-a2cd-4550b334348f tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.226780 Sep 11 15:18:05.146280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 287/577] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:04 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:05.172564 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:05.173214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:05.182577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:05.183073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:05.183513 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:05.184240 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:05.185212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:05.185212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:05.256455 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:05.265535 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-51d6e375-7e70-4a95-8002-9132c7de79d7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1289 microversion: 2.1 time: 0.104043 Sep 11 15:18:05.266450 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 291/578] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:05 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:06.190518 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:06.191734 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:06.199491 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:06.200067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:06.200566 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:06.201304 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:06.201753 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:06.202166 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:06.206649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:06.299238 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:06.299928 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:06.306901 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:06.307685 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:06.308230 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:06.308966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:06.310425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:06.311363 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:06.345711 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:06.355237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:06.356776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:06.358171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8db14f82-375c-47c8-842a-8773cc3bb9f9 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.172821 Sep 11 15:18:06.359072 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 288/579] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:06 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:06.383456 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:06.393706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0dc8b176-dbc8-4517-afc5-ccd6a6e88f4c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1295 microversion: 2.1 time: 0.098429 Sep 11 15:18:06.394671 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 292/580] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:06 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:18:07.344548 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-e454d460-cb81-41c6-98ff-29f3637f75fd req-2a2ec48c-4edc-4103-963f-3d57f6efde3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53bf29bf-c1c3-4a06-83c2-e3eb3df12430", "tag": "261aaf26-5f19-41e1-b97b-d37a713a7225"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:07.354488 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e454d460-cb81-41c6-98ff-29f3637f75fd req-2a2ec48c-4edc-4103-963f-3d57f6efde3e service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:07.354967 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e454d460-cb81-41c6-98ff-29f3637f75fd req-2a2ec48c-4edc-4103-963f-3d57f6efde3e service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:07.355396 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e454d460-cb81-41c6-98ff-29f3637f75fd req-2a2ec48c-4edc-4103-963f-3d57f6efde3e service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:07.366839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-e454d460-cb81-41c6-98ff-29f3637f75fd req-2a2ec48c-4edc-4103-963f-3d57f6efde3e service nova] Creating event network-changed:261aaf26-5f19-41e1-b97b-d37a713a7225 for instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 on hv-cinder-83976 Sep 11 15:18:07.372046 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-e454d460-cb81-41c6-98ff-29f3637f75fd req-2a2ec48c-4edc-4103-963f-3d57f6efde3e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091457 Sep 11 15:18:07.372651 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 289/581] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:07.383754 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:07.384390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:07.391376 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:07.391884 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:07.392465 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:07.393190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:07.393694 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:07.394177 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:07.418092 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:07.418849 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:07.425483 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:07.425969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:07.426371 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:07.427069 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:07.427530 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:07.427970 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:07.586808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:07.602791 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:07.610538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:07.616265 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:07.618715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c3ee5dfa-bfd2-4011-92d7-142d23f07ca8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.238466 Sep 11 15:18:07.619652 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 293/582] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:07 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:07.628415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8268a02f-69db-4167-9fbf-13c5737ef35a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1363 microversion: 2.1 time: 0.214216 Sep 11 15:18:07.629834 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 290/583] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:07 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:08.644839 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:08.646251 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:08.653648 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:08.654226 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:08.654756 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:08.654855 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:08.654944 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:08.655563 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:08.656012 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:08.656432 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:08.662627 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:08.663130 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:08.663563 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:08.664272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:08.664724 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:08.665198 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:08.863285 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:08.866738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:08.872923 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c80c5691-b855-479e-83a4-5d24b456deb5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1363 microversion: 2.1 time: 0.223258 Sep 11 15:18:08.873838 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 291/584] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:08 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:08.885252 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:08.885252 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:08.885252 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5e0186fe-ab3c-4ce2-aa29-d3f907d1746a tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.239191 Sep 11 15:18:08.885666 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 294/585] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:08 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:09.897022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:09.897687 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:09.904829 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:09.905356 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:09.905786 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:09.906519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:09.906971 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:09.907384 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:09.917828 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:09.918476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:09.925571 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:09.926084 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:09.926526 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:09.927235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:09.927687 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:09.928111 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:10.117661 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:10.132691 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b1776b45-4745-412a-ba87-6bb8a7117686 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1363 microversion: 2.1 time: 0.239105 Sep 11 15:18:10.133776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 292/586] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:09 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:10.148310 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:10.161262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:10.162847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:10.164139 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c3a1263c-e0b1-4c8d-8446-13a19e13efe7 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1744 microversion: 2.20 time: 0.251454 Sep 11 15:18:10.164714 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 295/587] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:09 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1744 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:11.165013 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:11.165778 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:11.173013 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:11.173536 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:11.173969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:11.174672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:11.175122 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:11.175541 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:11.191184 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:11.192003 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:11.198835 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:11.199330 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:11.199757 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:11.200499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:11.200949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:11.201377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:11.410647 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:11.419299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b3f4dff2-803e-41aa-a258-eb2142144f07 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1363 microversion: 2.1 time: 0.258103 Sep 11 15:18:11.420197 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 293/588] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:11 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:11.423282 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:11.432957 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:11.434453 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:11.435647 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fab28882-d720-4962-86f6-a3a28ad98831 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1744 microversion: 2.20 time: 0.248824 Sep 11 15:18:11.436211 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 296/589] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:11 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1744 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:12.443905 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:12.445254 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:12.452005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:12.452492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:12.453015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:12.453688 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:12.454141 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:12.456379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:12.463949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:12.464682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:12.477354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:12.478144 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:12.478743 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:12.479640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:12.480537 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:12.481117 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:12.713569 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:12.728842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:12.737494 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:12.739238 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9d202e8f-b3db-4d25-abce-5702089bc46c tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1739 microversion: 2.20 time: 0.281549 Sep 11 15:18:12.739820 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 297/590] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:12 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:12.750840 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:12.774374 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a11a8eb5-09e1-4070-9e52-c1d92f8c42f4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1363 microversion: 2.1 time: 0.334591 Sep 11 15:18:12.774971 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 294/591] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:12 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:13.109349 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-ff4c3023-97b8-4348-87e0-67e017486487 req-0fb039c4-276d-46c7-b603-6e594867ff86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53bf29bf-c1c3-4a06-83c2-e3eb3df12430", "name": "network-vif-plugged", "status": "completed", "tag": "261aaf26-5f19-41e1-b97b-d37a713a7225"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:13.121015 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ff4c3023-97b8-4348-87e0-67e017486487 req-0fb039c4-276d-46c7-b603-6e594867ff86 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:13.121841 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ff4c3023-97b8-4348-87e0-67e017486487 req-0fb039c4-276d-46c7-b603-6e594867ff86 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:13.122272 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ff4c3023-97b8-4348-87e0-67e017486487 req-0fb039c4-276d-46c7-b603-6e594867ff86 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:13.144672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-ff4c3023-97b8-4348-87e0-67e017486487 req-0fb039c4-276d-46c7-b603-6e594867ff86 service nova] Creating event network-vif-plugged:261aaf26-5f19-41e1-b97b-d37a713a7225 for instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 on hv-cinder-83976 Sep 11 15:18:13.150805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-ff4c3023-97b8-4348-87e0-67e017486487 req-0fb039c4-276d-46c7-b603-6e594867ff86 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139457 Sep 11 15:18:13.151417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 298/592] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:13.781230 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:13.783060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:13.788677 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:13.793729 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:13.794490 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:13.795089 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:13.797082 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:13.797701 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:13.798380 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:13.803523 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:13.805477 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:13.813612 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:13.814546 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:13.815239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:13.816721 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:13.817371 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:13.818558 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:13.843012 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:13.947851 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:13.976642 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=10 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:14.055074 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:14.072299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:14.073892 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:14.075532 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-002fd708-c513-4725-b240-f797d9629b78 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1739 microversion: 2.20 time: 0.301435 Sep 11 15:18:14.085032 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:14.095241 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4e2026b6-1a97-4578-a734-19c6ec0cb3f1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1363 microversion: 2.1 time: 0.296313 Sep 11 15:18:14.096279 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 295/593] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:13 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:14.109742 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 299/594] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:13 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:15.114467 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:15.115364 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:15.126943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:15.133916 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:15.135036 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:15.141641 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:15.142526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:15.143140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:15.143852 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:15.144461 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:15.144881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:15.147511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:15.150496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:15.150496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:15.150496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:15.150496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:15.151268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:15.409999 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:15.417328 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:15.423400 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dfb68b6a-a4b9-4b06-b6e5-01da830b35ee tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1363 microversion: 2.1 time: 0.297989 Sep 11 15:18:15.434894 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 300/595] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:15 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:15.435128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:15.435128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:15.435128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f0223528-7f3d-416c-a811-1df724823250 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1739 microversion: 2.20 time: 0.322510 Sep 11 15:18:15.439879 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-a045672f-e32a-4b21-8442-58f44cab5e63 req-64fde35f-e3f1-4596-ac3e-557e1ac4758d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ed2d84-4e3f-48cd-98a1-00bc736956fa", "name": "network-vif-plugged", "status": "completed", "tag": "dc11bee5-2af5-4d4d-9c05-1df367d916f1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:15.442195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 296/596] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:15 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:15.449694 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a045672f-e32a-4b21-8442-58f44cab5e63 req-64fde35f-e3f1-4596-ac3e-557e1ac4758d service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:15.451859 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a045672f-e32a-4b21-8442-58f44cab5e63 req-64fde35f-e3f1-4596-ac3e-557e1ac4758d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:15.452567 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a045672f-e32a-4b21-8442-58f44cab5e63 req-64fde35f-e3f1-4596-ac3e-557e1ac4758d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:15.465901 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-a045672f-e32a-4b21-8442-58f44cab5e63 req-64fde35f-e3f1-4596-ac3e-557e1ac4758d service nova] Creating event network-vif-plugged:dc11bee5-2af5-4d4d-9c05-1df367d916f1 for instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa on hv-cinder-83976 Sep 11 15:18:15.471232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-a045672f-e32a-4b21-8442-58f44cab5e63 req-64fde35f-e3f1-4596-ac3e-557e1ac4758d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043920 Sep 11 15:18:15.472201 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 301/597] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:16.448609 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:16.449224 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:16.455355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:16.456140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:16.456565 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:16.457462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:16.458126 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:16.458705 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:16.463622 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:16.464927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:16.467846 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=56 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:16.478913 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:16.482867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:16.484476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:16.485809 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:16.486687 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:16.487343 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:16.669667 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:16.681005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-219f5ac9-ce7f-4900-91f6-f0cc64b0949b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1548 microversion: 2.1 time: 0.236797 Sep 11 15:18:16.681795 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 297/598] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:16 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:16.684943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:16.697127 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:16.699236 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:16.700606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-26a558f3-5ba9-44b2-a33b-065d237c7933 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1739 microversion: 2.20 time: 0.244228 Sep 11 15:18:16.704121 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ad0fce22-072d-4b4e-9919-9473c04f8d4f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:16.704605 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ad0fce22-072d-4b4e-9919-9473c04f8d4f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:16.705954 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 302/599] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:16 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:16.714387 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad0fce22-072d-4b4e-9919-9473c04f8d4f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:16.715073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad0fce22-072d-4b4e-9919-9473c04f8d4f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:16.715813 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad0fce22-072d-4b4e-9919-9473c04f8d4f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:16.716659 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad0fce22-072d-4b4e-9919-9473c04f8d4f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:16.717294 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad0fce22-072d-4b4e-9919-9473c04f8d4f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:16.717863 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad0fce22-072d-4b4e-9919-9473c04f8d4f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:16.811847 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ad0fce22-072d-4b4e-9919-9473c04f8d4f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111486 Sep 11 15:18:16.812810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 298/600] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 15:18:16 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:17.729759 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:17.733574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:17.745048 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:17.753682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:17.754482 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:17.759784 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:17.762665 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:17.763091 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:17.945909 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b1d774ce-b516-4c60-ae19-86bd4e40a3f2 req-c3911ea4-997b-424f-932c-9cd04347ceb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53bf29bf-c1c3-4a06-83c2-e3eb3df12430", "tag": "261aaf26-5f19-41e1-b97b-d37a713a7225"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:17.959970 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b1d774ce-b516-4c60-ae19-86bd4e40a3f2 req-c3911ea4-997b-424f-932c-9cd04347ceb7 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:17.960797 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b1d774ce-b516-4c60-ae19-86bd4e40a3f2 req-c3911ea4-997b-424f-932c-9cd04347ceb7 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:17.961489 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b1d774ce-b516-4c60-ae19-86bd4e40a3f2 req-c3911ea4-997b-424f-932c-9cd04347ceb7 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:17.993798 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b1d774ce-b516-4c60-ae19-86bd4e40a3f2 req-c3911ea4-997b-424f-932c-9cd04347ceb7 service nova] Creating event network-changed:261aaf26-5f19-41e1-b97b-d37a713a7225 for instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 on hv-cinder-83976 Sep 11 15:18:18.007616 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b1d774ce-b516-4c60-ae19-86bd4e40a3f2 req-c3911ea4-997b-424f-932c-9cd04347ceb7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065132 Sep 11 15:18:18.009268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 299/601] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:18:18.046163 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:18.057776 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:18.062964 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:18.066406 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4cacde80-8bf0-4abb-b7d5-65e009c31ad4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1739 microversion: 2.20 time: 0.340753 Sep 11 15:18:18.067882 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 303/602] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:17 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:19.103963 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:19.107630 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:19.123672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:19.125422 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:19.126462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:19.127261 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:19.134299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:19.135352 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:19.374205 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:19.384249 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:19.387641 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:19.387872 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4450c0b2-1fe3-4cf0-87f9-c627ddf64ed6 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1739 microversion: 2.20 time: 0.296963 Sep 11 15:18:19.404233 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 300/603] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:19 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:20.416873 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:20.417849 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:20.432894 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:20.434021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:20.434827 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:20.436329 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:20.437451 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:20.438597 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:20.701293 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:20.719236 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:20.720669 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:20.721933 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d960183a-4293-4fde-9c2b-8155e9a0ef47 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1739 microversion: 2.20 time: 0.311105 Sep 11 15:18:20.722493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 304/604] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:20 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:21.760493 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:21.761545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:21.774012 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:21.774803 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:21.775699 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:21.777609 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:21.779005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:21.780627 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:21.955223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:21.963880 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:21.965351 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:21.966542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8d36d37f-f9fc-4ec3-867c-b5b79176fdb4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1739 microversion: 2.20 time: 0.212378 Sep 11 15:18:21.967108 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 301/605] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:21 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:22.992872 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:22.993596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:23.000110 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:23.000612 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:23.001024 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:23.001771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:23.002202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:23.002617 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:23.143912 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:23.153996 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:23.155231 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:23.156388 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6a26e373-d8ef-4c80-ada9-c7777eb316b3 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1721 microversion: 2.20 time: 0.168182 Sep 11 15:18:23.156940 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 305/606] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:22 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:23.909495 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2fff4333-8e60-4dfe-9e0d-630c5055c63f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:23.910314 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2fff4333-8e60-4dfe-9e0d-630c5055c63f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:23.917231 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fff4333-8e60-4dfe-9e0d-630c5055c63f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:23.917751 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fff4333-8e60-4dfe-9e0d-630c5055c63f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:23.918182 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fff4333-8e60-4dfe-9e0d-630c5055c63f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:23.918881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fff4333-8e60-4dfe-9e0d-630c5055c63f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:23.919346 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fff4333-8e60-4dfe-9e0d-630c5055c63f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:23.919768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fff4333-8e60-4dfe-9e0d-630c5055c63f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:23.945938 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2fff4333-8e60-4dfe-9e0d-630c5055c63f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/ips" status: 200 len: 150 microversion: 2.1 time: 0.040417 Sep 11 15:18:23.946534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 302/607] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:18:23 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:24.182682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:24.183461 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:24.191065 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:24.191565 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:24.192035 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:24.192755 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:24.193231 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:24.193842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:24.367487 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:24.376726 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:24.378172 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:24.379383 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-afe3e226-da7d-4f8a-8908-ab5069e7afad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1721 microversion: 2.20 time: 0.201191 Sep 11 15:18:24.379915 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 306/608] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:24 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:18:25.407201 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:25.407804 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:25.415732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:25.416319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:25.416758 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:25.417509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:25.417954 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:25.418366 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:25.422654 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7d401e7e-427a-45cd-902d-13ba12b01eb6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b9e0fc9-6809-44d2-8a3a-4aabf6393a2d"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:25.425028 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7d401e7e-427a-45cd-902d-13ba12b01eb6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:25.432163 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d401e7e-427a-45cd-902d-13ba12b01eb6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:25.432643 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d401e7e-427a-45cd-902d-13ba12b01eb6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:25.433073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d401e7e-427a-45cd-902d-13ba12b01eb6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:25.433816 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d401e7e-427a-45cd-902d-13ba12b01eb6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:25.434260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d401e7e-427a-45cd-902d-13ba12b01eb6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:25.434670 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d401e7e-427a-45cd-902d-13ba12b01eb6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:25.584807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:25.593644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:25.595423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:25.596613 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-01a8f586-41cb-4c2d-a93b-efa5a107a288 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1664 microversion: 2.20 time: 0.193911 Sep 11 15:18:25.597364 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 303/609] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:25 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1664 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:25.621756 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-55f57047-402b-4f49-b270-40a487a19ea4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f828b404-4802-482a-ab96-5e3e7e15dd33"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:25.624402 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-55f57047-402b-4f49-b270-40a487a19ea4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:25.631075 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55f57047-402b-4f49-b270-40a487a19ea4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:25.631520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55f57047-402b-4f49-b270-40a487a19ea4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:25.631911 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55f57047-402b-4f49-b270-40a487a19ea4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:25.632805 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55f57047-402b-4f49-b270-40a487a19ea4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:25.633327 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55f57047-402b-4f49-b270-40a487a19ea4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:25.633742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55f57047-402b-4f49-b270-40a487a19ea4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:25.734156 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7d401e7e-427a-45cd-902d-13ba12b01eb6 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "POST /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316003 Sep 11 15:18:25.734771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 307/610] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:18:25 2022] POST /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:25.971670 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:25.985444 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-55f57047-402b-4f49-b270-40a487a19ea4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.367580 Sep 11 15:18:25.986617 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 304/611] 10.222.0.44 () {62 vars in 1364 bytes} [Sun Sep 11 15:18:25 2022] POST /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/os-volume_attachments => generated 188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 15:18:26.123371 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2f90d48a-f73a-4d1c-af17-0084e4e6e188 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:26.123947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2f90d48a-f73a-4d1c-af17-0084e4e6e188 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:26.131019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f90d48a-f73a-4d1c-af17-0084e4e6e188 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:26.131494 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f90d48a-f73a-4d1c-af17-0084e4e6e188 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:26.131931 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f90d48a-f73a-4d1c-af17-0084e4e6e188 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:26.132619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f90d48a-f73a-4d1c-af17-0084e4e6e188 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:26.133223 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f90d48a-f73a-4d1c-af17-0084e4e6e188 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:26.133651 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f90d48a-f73a-4d1c-af17-0084e4e6e188 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:26.444152 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2f90d48a-f73a-4d1c-af17-0084e4e6e188 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/os-volume_attachments/f828b404-4802-482a-ab96-5e3e7e15dd33" status: 202 len: 0 microversion: 2.20 time: 0.325077 Sep 11 15:18:26.445342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 308/612] 10.222.0.44 () {60 vars in 1457 bytes} [Sun Sep 11 15:18:26 2022] DELETE /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/os-volume_attachments/f828b404-4802-482a-ab96-5e3e7e15dd33 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:18:26.510912 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:26.511551 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:26.518571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:26.519063 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:26.519499 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:26.520202 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:26.520652 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:26.521068 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:26.569902 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120739) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 15:18:26.665012 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-74f74100-d5c2-4a73-b3f1-8b1345efbb50 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "POST /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/action" status: 202 len: 0 microversion: 2.20 time: 0.158146 Sep 11 15:18:26.666182 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 305/613] 10.222.0.44 () {62 vars in 1319 bytes} [Sun Sep 11 15:18:26 2022] POST /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:18:26.677174 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:26.677698 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:26.686286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:26.686780 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:26.689220 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:26.690908 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:26.691100 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-850e45c5-85f5-4752-a754-e15fe218efb0 req-f7abd7a2-3bcf-4ed9-80a1-ed682096f609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ed2d84-4e3f-48cd-98a1-00bc736956fa", "name": "network-vif-unplugged", "status": "completed", "tag": "dc11bee5-2af5-4d4d-9c05-1df367d916f1"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:26.691352 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:26.691778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:26.702060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-850e45c5-85f5-4752-a754-e15fe218efb0 req-f7abd7a2-3bcf-4ed9-80a1-ed682096f609 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:26.702556 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-850e45c5-85f5-4752-a754-e15fe218efb0 req-f7abd7a2-3bcf-4ed9-80a1-ed682096f609 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:26.702987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-850e45c5-85f5-4752-a754-e15fe218efb0 req-f7abd7a2-3bcf-4ed9-80a1-ed682096f609 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:26.722348 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.compute.server_external_events [req-850e45c5-85f5-4752-a754-e15fe218efb0 req-f7abd7a2-3bcf-4ed9-80a1-ed682096f609 service nova] Unable to find a host for instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa. Dropping event network-vif-unplugged {{(pid=120739) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 11 15:18:26.724253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-850e45c5-85f5-4752-a754-e15fe218efb0 req-f7abd7a2-3bcf-4ed9-80a1-ed682096f609 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039930 Sep 11 15:18:26.725943 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 306/614] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 11 15:18:26.847878 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:26.858914 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:26.861398 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:26.862735 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1c247dd8-7b2b-4afe-a2e9-fd370e6935a8 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1672 microversion: 2.20 time: 0.190303 Sep 11 15:18:26.863375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 309/615] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:26 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1672 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:27.889250 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:27.889884 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:27.896836 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:27.897362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:27.897754 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:27.898687 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:27.899121 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:27.899746 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:28.056306 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:28.065090 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:28.066950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:28.068128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ef4a8225-572f-451a-b3d3-2c8eb7507ae1 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.183153 Sep 11 15:18:28.068690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 307/616] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:27 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:29.097815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:29.098800 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:29.109656 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:29.110446 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:29.111309 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:29.112470 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:29.113217 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:29.114032 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:29.264991 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:29.276323 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:29.277823 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:29.279031 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-77292ff0-873e-4255-8a09-e091d26bb8af tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.188215 Sep 11 15:18:29.279595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 310/617] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:29 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:30.304787 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:30.305370 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:30.318460 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:30.319136 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:30.319576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:30.320526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:30.321011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:30.321466 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:30.476353 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:30.487408 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:30.488827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:30.490042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e712586d-d4a4-4395-b43a-5d588caf2220 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.189592 Sep 11 15:18:30.490623 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 308/618] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:30 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:31.517311 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:31.518096 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:31.525747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:31.526242 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:31.526668 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:31.527376 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:31.527902 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:31.528269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:31.688461 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:31.705075 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:31.708287 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:31.710194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-64cf1717-42fc-4879-a50a-9f98102d2268 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.197586 Sep 11 15:18:31.725949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 311/619] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:31 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 15:18:32.738095 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:32.738685 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:32.745442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:32.745922 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:32.746349 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:32.747054 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:32.747495 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:32.747910 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:32.886951 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:32.896487 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:32.898307 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:32.899519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-077e2a9d-3aec-4063-aea1-54ad68bb7516 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.165406 Sep 11 15:18:32.900107 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 309/620] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:32 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:33.926049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:33.927296 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:33.935150 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:33.935745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:33.936261 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:33.937289 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:33.937820 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:33.938424 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:33.962280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:34.126964 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:34.138561 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:34.141210 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:34.141822 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-16806691-3f27-493e-9ec0-a11c5d15e11b tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.220635 Sep 11 15:18:34.142398 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 312/621] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:33 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:35.168467 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:35.169057 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:35.177509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:35.178052 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:35.178926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:35.180117 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:35.180839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:35.181539 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:35.332595 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:35.341914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:35.343412 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:35.344541 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b2e0d523-7380-4ec0-af73-ebfb18718810 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.180483 Sep 11 15:18:35.345104 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 310/622] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:35 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:36.369957 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:36.371194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:36.381560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:36.382046 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:36.382469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:36.383166 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:36.383584 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:36.384019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:36.535759 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:36.545350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:36.546806 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:36.548076 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2fcd6ac6-8d08-4177-bce1-aad8172e55bf tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.182311 Sep 11 15:18:36.548849 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 313/623] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:36 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:37.578860 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:37.579443 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:37.586854 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:37.587335 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:37.587768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:37.588456 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:37.588906 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:37.589391 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:37.729801 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:37.739086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:37.740511 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:37.741713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4ba9c30c-e95f-4423-973d-f74b380cdfb5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.167279 Sep 11 15:18:37.742286 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 311/624] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:37 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:38.770302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:38.770939 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:38.779334 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:38.779824 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:38.780253 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:38.780943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:38.781419 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:38.781880 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:38.922427 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:38.932396 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:38.933873 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:38.935067 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0d8ca7f3-8c46-4d2f-af49-42da135825bd tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.170856 Sep 11 15:18:38.945365 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 314/625] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:38 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:39.950469 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:39.951065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:39.958482 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:39.958953 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:39.959383 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:39.960089 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:39.960547 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:39.960973 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:39.964501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:39.965182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:39.973245 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:39.974192 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:39.975061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:39.976050 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:39.976881 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:39.977351 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:40.051585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lazy-loading 'services' on Instance uuid 88a55130-37ac-4875-9029-bedc43fc2149 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:18:40.131820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-63a08316-0568-462a-9a20-06e4cc624136 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-volume_attachments/1b9e0fc9-6809-44d2-8a3a-4aabf6393a2d" status: 202 len: 0 microversion: 2.1 time: 0.185059 Sep 11 15:18:40.132451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 312/626] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:18:39 2022] DELETE /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-volume_attachments/1b9e0fc9-6809-44d2-8a3a-4aabf6393a2d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:18:40.135482 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:40.153404 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f81245a6-61b8-491b-9ea9-56d52ce42432 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:40.156538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f81245a6-61b8-491b-9ea9-56d52ce42432 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:40.164176 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f81245a6-61b8-491b-9ea9-56d52ce42432 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:40.164680 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f81245a6-61b8-491b-9ea9-56d52ce42432 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:40.165398 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f81245a6-61b8-491b-9ea9-56d52ce42432 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:40.165770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:40.166611 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f81245a6-61b8-491b-9ea9-56d52ce42432 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:40.167231 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f81245a6-61b8-491b-9ea9-56d52ce42432 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:40.167807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f81245a6-61b8-491b-9ea9-56d52ce42432 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:40.172655 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:40.174727 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b003c46b-966f-46f4-a73a-de266d848829 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.214146 Sep 11 15:18:40.175531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 315/627] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:39 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:40.203922 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f81245a6-61b8-491b-9ea9-56d52ce42432 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065500 Sep 11 15:18:40.204509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 313/628] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:18:40 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:41.204619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:41.205550 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:41.212169 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:41.212642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:41.213087 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:41.213842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:41.214372 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:41.215377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:41.220874 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a002b84b-5725-4b19-969b-c729d151c8e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:41.223967 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a002b84b-5725-4b19-969b-c729d151c8e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:41.231550 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a002b84b-5725-4b19-969b-c729d151c8e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:41.232060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a002b84b-5725-4b19-969b-c729d151c8e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:41.232507 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a002b84b-5725-4b19-969b-c729d151c8e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:41.233233 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a002b84b-5725-4b19-969b-c729d151c8e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:41.233994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a002b84b-5725-4b19-969b-c729d151c8e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:41.234421 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a002b84b-5725-4b19-969b-c729d151c8e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:41.276690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a002b84b-5725-4b19-969b-c729d151c8e5 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061274 Sep 11 15:18:41.277698 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 314/629] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:18:41 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 15:18:41.347286 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:41.347758 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:41.354094 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:41.354857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:41.355295 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:41.355997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:41.356473 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:41.356893 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:41.379828 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:41.388715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:41.390194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:41.390759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:18:41.391435 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c490a4a4-c450-4f03-98af-53dcdbf66580 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.190787 Sep 11 15:18:41.392008 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 316/630] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:41 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:41.483339 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-35e61f66-e43d-4088-9408-f61dc548f9fd tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 204 len: 0 microversion: 2.1 time: 0.139313 Sep 11 15:18:41.484324 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 315/631] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:18:41 2022] DELETE /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 15:18:41.492993 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:41.493649 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:41.499670 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:41.500135 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:41.500558 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:41.501283 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:41.501723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:41.502131 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:41.651686 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:41.659643 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-92c62744-922d-45fc-b4a9-0b2b70913b60 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1678 microversion: 2.1 time: 0.170510 Sep 11 15:18:41.660222 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 317/632] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:41 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:42.421170 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:42.421889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:42.429659 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:42.430156 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:42.430590 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:42.431308 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:42.431766 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:42.432187 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:42.571943 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:42.582179 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:42.583737 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:42.585005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-68401a40-ffff-4432-b0e4-82ed03480aad tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.168342 Sep 11 15:18:42.585736 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 316/633] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:42 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:42.684244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:42.684859 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:42.692958 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:42.693471 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:42.693906 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:42.694777 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:42.695266 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:42.695826 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:42.763710 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b9b382cb-79e4-4eeb-a3fd-0c899e8592e8 req-4c6d0255-8322-40f5-82c3-26dc975834b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ed2d84-4e3f-48cd-98a1-00bc736956fa", "name": "network-vif-plugged", "status": "completed", "tag": "dc11bee5-2af5-4d4d-9c05-1df367d916f1"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:42.780317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b9b382cb-79e4-4eeb-a3fd-0c899e8592e8 req-4c6d0255-8322-40f5-82c3-26dc975834b5 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:42.781108 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b9b382cb-79e4-4eeb-a3fd-0c899e8592e8 req-4c6d0255-8322-40f5-82c3-26dc975834b5 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:42.781877 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b9b382cb-79e4-4eeb-a3fd-0c899e8592e8 req-4c6d0255-8322-40f5-82c3-26dc975834b5 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:42.804249 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b9b382cb-79e4-4eeb-a3fd-0c899e8592e8 req-4c6d0255-8322-40f5-82c3-26dc975834b5 service nova] Creating event network-vif-plugged:dc11bee5-2af5-4d4d-9c05-1df367d916f1 for instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa on hv-cinder-83976 Sep 11 15:18:42.812726 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b9b382cb-79e4-4eeb-a3fd-0c899e8592e8 req-4c6d0255-8322-40f5-82c3-26dc975834b5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055250 Sep 11 15:18:42.813622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 317/634] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:18:42.852305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:42.862952 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-05f47468-fef1-4d0f-a345-f4f30796c0e4 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1678 microversion: 2.1 time: 0.183148 Sep 11 15:18:42.863547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 318/635] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:42 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:43.612880 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:43.613734 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:43.620819 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:43.621481 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:43.621932 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:43.622702 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:43.623448 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:43.624030 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:43.780267 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:43.787533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:43.800300 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:43.803337 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:43.805791 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c80ca872-a910-4997-9fdb-ffbeb7c601f0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.198122 Sep 11 15:18:43.807287 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 318/636] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:43 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:43.890448 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:43.891534 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:43.904631 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:43.907781 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:43.907781 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:43.908682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:43.909568 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:43.910316 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:43.982754 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:43.991249 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ddb60f4b-a0d0-46e6-b73c-be24e64ff39b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1612 microversion: 2.1 time: 0.106669 Sep 11 15:18:43.991883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 319/637] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:43 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1612 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:44.069893 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-881af9c2-2d19-4b2c-aa0f-dc099935ba6d req-a89fa9cf-18f7-4941-b53c-0a14f375fe22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a55130-37ac-4875-9029-bedc43fc2149", "name": "network-vif-deleted", "tag": "7104d628-55df-402f-9a4c-e4007e2130f6"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:44.076886 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:44.081081 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-881af9c2-2d19-4b2c-aa0f-dc099935ba6d req-a89fa9cf-18f7-4941-b53c-0a14f375fe22 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:44.081081 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-881af9c2-2d19-4b2c-aa0f-dc099935ba6d req-a89fa9cf-18f7-4941-b53c-0a14f375fe22 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:44.082197 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-881af9c2-2d19-4b2c-aa0f-dc099935ba6d req-a89fa9cf-18f7-4941-b53c-0a14f375fe22 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:44.110768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-881af9c2-2d19-4b2c-aa0f-dc099935ba6d req-a89fa9cf-18f7-4941-b53c-0a14f375fe22 service nova] Creating event network-vif-deleted:7104d628-55df-402f-9a4c-e4007e2130f6 for instance 88a55130-37ac-4875-9029-bedc43fc2149 on hv-cinder-83976 Sep 11 15:18:44.116382 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-881af9c2-2d19-4b2c-aa0f-dc099935ba6d req-a89fa9cf-18f7-4941-b53c-0a14f375fe22 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050134 Sep 11 15:18:44.117198 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 319/638] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:44.832537 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:44.833510 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:44.840678 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:44.841190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:44.841834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:44.842568 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:44.843013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:44.843429 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:45.003669 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:45.014175 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:45.016990 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:45.019356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fe127cca-ab38-4860-832b-310a645302ef tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1730 microversion: 2.20 time: 0.190281 Sep 11 15:18:45.031405 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:45.033392 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:45.039069 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 320/639] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:44 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:45.044926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:45.045827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:45.046622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:45.048091 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:45.048854 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:45.049339 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:45.092396 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:45.093110 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:45.093906 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:45.094775 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lazy-loading 'fault' on Instance uuid 88a55130-37ac-4875-9029-bedc43fc2149 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:18:45.153203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44105f2d90e469fb03f311a4cf1476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0693786c6694f9e8a8bb8bec8fba0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:45.165876 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ce57357-3a6e-4cea-9c41-92cfcfacca34 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 200 len: 1329 microversion: 2.1 time: 0.151328 Sep 11 15:18:45.166951 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 320/640] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:45 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 1329 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:18:46.046286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:46.046881 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:46.055744 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:46.056227 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:46.056663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:46.057415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:46.057869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:46.058280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:46.195434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:46.196546 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:46.205663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:46.208373 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:46.209262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:46.209994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:46.211290 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:46.212133 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:46.212912 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:46.217823 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:46.219385 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:18:46.220727 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b2750fc8-2bd3-48f8-886d-77de45f61f74 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1717 microversion: 2.20 time: 0.178408 Sep 11 15:18:46.221555 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 321/641] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:18:46 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:18:46.232285 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 HTTP/1.1 Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:18:46.234162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:46.235761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '88a55130-37ac-4875-9029-bedc43fc2149'} Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:18:46.236569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:46.237835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:46.238967 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:18:46.238967 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ecf2e78b-f10c-4cca-a4bf-c3fea2746e6b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 404 len: 111 microversion: 2.1 time: 0.048237 Sep 11 15:18:46.238967 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 321/642] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:46 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:18:46.246963 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1b703c14-c09d-411b-ab7e-59753dd13f51 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '.version_select at 0x7f3933f8ba60>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:46.272806 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1b703c14-c09d-411b-ab7e-59753dd13f51 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791036522" status: 202 len: 0 microversion: 2.1 time: 0.029672 Sep 11 15:18:46.273865 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 322/643] 10.222.0.44 () {58 vars in 1218 bytes} [Sun Sep 11 15:18:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791036522 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:18:48.146145 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:48.146730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:48.153574 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:48.154068 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:48.154500 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:48.155214 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:48.155653 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:48.156072 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:48.171377 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 HTTP/1.1 Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:18:48.172950 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.174534 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '88a55130-37ac-4875-9029-bedc43fc2149'} Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:18:48.175415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.176780 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.178333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:18:48.178333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-25520c7f-c5b3-4f8d-8167-972810ae554c tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 404 len: 111 microversion: 2.1 time: 0.032556 Sep 11 15:18:48.178333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 322/644] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:18:48 2022] DELETE /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:18:48.183784 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:48.184356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 88a55130-37ac-4875-9029-bedc43fc2149] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:48.186326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:48.193414 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:48.194011 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:48.194591 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:48.195439 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:48.195958 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:48.196414 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:48.211906 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 HTTP/1.1 Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:18:48.213638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.215202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '88a55130-37ac-4875-9029-bedc43fc2149'} Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:18:48.216040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. Sep 11 15:18:48.217428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:48.218640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance 88a55130-37ac-4875-9029-bedc43fc2149 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:18:48.218640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bbf12d7e-93ce-4ff8-88a9-baa18c345671 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149" status: 404 len: 111 microversion: 2.1 time: 0.035818 Sep 11 15:18:48.218640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 323/645] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:48 2022] GET /compute/v2.1/servers/88a55130-37ac-4875-9029-bedc43fc2149 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:18:49.381520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:49.382273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:49.388560 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:49.389015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:49.389491 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:49.390175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:49.390676 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:49.391115 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:49.405063 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 HTTP/1.1 Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:18:49.406639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.408336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'd13dbbe8-b0bd-4845-9f5a-38f35a2415d1'} Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:18:49.409175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.410533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.412385 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:18:49.412385 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2fd50595-b137-4356-9482-f38135c051c3 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 404 len: 111 microversion: 2.1 time: 0.030532 Sep 11 15:18:49.412385 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 323/646] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:18:49 2022] DELETE /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:18:49.417697 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:49.418357 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: d13dbbe8-b0bd-4845-9f5a-38f35a2415d1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:49.425066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:49.425562 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:49.425968 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:49.426656 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:49.427098 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:49.427544 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:49.442750 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 HTTP/1.1 Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:18:49.444302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.446818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'd13dbbe8-b0bd-4845-9f5a-38f35a2415d1'} Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:18:49.447724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. Sep 11 15:18:49.448951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.450253 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:18:49.450253 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bb5c912b-d6d0-4434-9622-76e1171cc25b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1" status: 404 len: 111 microversion: 2.1 time: 0.032456 Sep 11 15:18:49.450253 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 324/647] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:49 2022] GET /compute/v2.1/servers/d13dbbe8-b0bd-4845-9f5a-38f35a2415d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:18:49.455054 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:49.455545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:49.462014 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:49.462768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:49.463264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:49.463968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:49.464415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:49.464816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:49.479757 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 HTTP/1.1 Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:18:49.481237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.482764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35'} Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:18:49.483673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.484926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.486134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:18:49.486134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-01038f6a-bcf2-4886-bd01-6d73cbb63fe9 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 404 len: 111 microversion: 2.1 time: 0.031555 Sep 11 15:18:49.486134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 324/648] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:18:49 2022] DELETE /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:18:49.492231 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:49.492840 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:49.499772 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:49.500237 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:49.500671 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:49.501476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:49.501930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:49.502349 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:49.517178 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 HTTP/1.1 Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:18:49.518746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.520263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35'} Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:18:49.521099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. Sep 11 15:18:49.522392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:49.523454 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:18:49.523454 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c436a297-934f-400c-a29b-6466b7c53e0f tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35" status: 404 len: 111 microversion: 2.1 time: 0.032409 Sep 11 15:18:49.523454 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 325/649] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:49 2022] GET /compute/v2.1/servers/bf538e9f-c5a3-4bcf-90db-c1ff31e8eb35 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:18:50.674441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:50.674988 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:50.681800 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:50.682303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:50.682725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:50.683401 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:50.683839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:50.684255 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:50.698254 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 HTTP/1.1 Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:18:50.699774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.701272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '57cbd483-4673-4cba-a512-0585e93c4b00'} Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:18:50.702134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.703571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.705083 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:18:50.705083 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-aaa6f1f0-5d29-45af-9225-832a585d5804 tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "DELETE /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 404 len: 111 microversion: 2.1 time: 0.030605 Sep 11 15:18:50.705083 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 325/650] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:18:50 2022] DELETE /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:18:50.710058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:50.710556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] [instance: 57cbd483-4673-4cba-a512-0585e93c4b00] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:50.717826 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:50.718378 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:50.718723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:50.719413 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:50.719846 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:50.720258 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:50.734782 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] HTTP exception thrown: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Request method failure captured: Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 HTTP/1.1 Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrkDvm84br5VFkxXAYfc1KY6nedQRdjTnMovHKbNmzqrtVYnZpP8lUg_ii_8QGWsf7ZU3PMYg18mGbwP8_QMtrM2YfQ-Cn5gEDP6-n_4-fpj-kbr4-FQiUVo968VOLqm5tOVKhbRAUdb4w_lw9vjVXbcP2HdLB7e-iWkqlj0haKRGE Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:18:50.736298 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0693786c6694f9e8a8bb8bec8fba0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: c0693786c6694f9e8a8bb8bec8fba0b5 Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-628112889 Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: c44105f2d90e469fb03f311a4cf1476f Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-628112889-project Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.737799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '57cbd483-4673-4cba-a512-0585e93c4b00'} Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:18:50.738667 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. Sep 11 15:18:50.740054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:18:50.741303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] Returning 404 to user: Instance 57cbd483-4673-4cba-a512-0585e93c4b00 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:18:50.741303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dc14bbd6-449d-4127-b170-e3ccce50454b tempest-AttachVolumeNegativeTest-628112889 tempest-AttachVolumeNegativeTest-628112889-project] 10.222.0.44 "GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00" status: 404 len: 111 microversion: 2.1 time: 0.031777 Sep 11 15:18:50.741303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 326/651] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:18:50 2022] GET /compute/v2.1/servers/57cbd483-4673-4cba-a512-0585e93c4b00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:18:54.437798 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8289faac-f4df-4079-b8ee-15d497e0e0e7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:18:54.438327 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8289faac-f4df-4079-b8ee-15d497e0e0e7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:54.445576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8289faac-f4df-4079-b8ee-15d497e0e0e7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:54.446057 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8289faac-f4df-4079-b8ee-15d497e0e0e7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:54.446487 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8289faac-f4df-4079-b8ee-15d497e0e0e7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:54.447225 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8289faac-f4df-4079-b8ee-15d497e0e0e7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:54.447674 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8289faac-f4df-4079-b8ee-15d497e0e0e7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:54.448090 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8289faac-f4df-4079-b8ee-15d497e0e0e7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:54.472758 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8289faac-f4df-4079-b8ee-15d497e0e0e7 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/ips" status: 200 len: 144 microversion: 2.1 time: 0.038905 Sep 11 15:18:54.473683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 326/652] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:18:54 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:18:56.791595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c38c0278-fbab-40fa-8b9f-08af17f09ec3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcbf2db0-2106-49fd-9b93-d945b70f9947"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:18:56.794035 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c38c0278-fbab-40fa-8b9f-08af17f09ec3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:18:56.801165 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c38c0278-fbab-40fa-8b9f-08af17f09ec3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:56.801681 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c38c0278-fbab-40fa-8b9f-08af17f09ec3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:56.802108 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c38c0278-fbab-40fa-8b9f-08af17f09ec3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:56.802807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c38c0278-fbab-40fa-8b9f-08af17f09ec3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:18:56.803252 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c38c0278-fbab-40fa-8b9f-08af17f09ec3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:18:56.803668 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c38c0278-fbab-40fa-8b9f-08af17f09ec3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:18:57.071601 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c38c0278-fbab-40fa-8b9f-08af17f09ec3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284161 Sep 11 15:18:57.072218 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 327/653] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:18:56 2022] POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:03.608941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-803432d7-dbf8-47c3-8b45-e8621fec9b2f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:19:03.616860 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-803432d7-dbf8-47c3-8b45-e8621fec9b2f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:03.617386 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-803432d7-dbf8-47c3-8b45-e8621fec9b2f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:03.617908 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-803432d7-dbf8-47c3-8b45-e8621fec9b2f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:03.686250 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-803432d7-dbf8-47c3-8b45-e8621fec9b2f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Going to try to stop instance {{(pid=120739) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 15:19:03.738202 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-803432d7-dbf8-47c3-8b45-e8621fec9b2f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/action" status: 202 len: 0 microversion: 2.1 time: 0.133357 Sep 11 15:19:03.738819 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 327/654] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:19:03 2022] POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:19:03.749676 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:03.750476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:03.757418 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:03.758058 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:03.758600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:03.759440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:03.759895 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:03.760320 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:03.904233 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:03.912562 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-443c9ba9-49bb-4c22-9831-cbd993e07128 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.168051 Sep 11 15:19:03.913213 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 328/655] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:03 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:04.940256 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:04.940939 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:04.948808 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:04.949325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:04.949753 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:04.950504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:04.950949 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:04.951362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:05.091156 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:05.103713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c1f55d6e-a4da-437a-a52f-8decef7a805c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.170117 Sep 11 15:19:05.104576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 328/656] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:04 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:06.128148 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:06.129026 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:06.135896 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:06.136382 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:06.136840 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:06.137573 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:06.138025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:06.138443 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:06.145982 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:19:06.279716 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:06.300201 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2d4135bb-ef3b-4dd3-a09d-f5eeaa008751 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.176044 Sep 11 15:19:06.300813 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 329/657] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:06 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:07.324654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:07.325435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:07.332547 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:07.333017 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:07.333486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:07.334171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:07.334630 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:07.335052 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:07.477182 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:07.488709 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3f2f7cc2-2cc4-485e-9502-998aeaa709f9 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.168619 Sep 11 15:19:07.489544 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 329/658] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:07 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:08.513244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:08.513851 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:08.520047 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:08.520517 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:08.520943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:08.521650 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:08.522096 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:08.522504 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:08.669337 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:08.678273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-412c6035-4e27-49ae-9d06-378e24fd3085 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.168949 Sep 11 15:19:08.678776 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 330/659] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:08 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:09.702129 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:09.702768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:09.709922 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:09.710806 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:09.711243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:09.711934 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:09.712379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:09.712797 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:09.847443 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:09.856181 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-be8e6d3d-9d3a-4339-a803-43118b7df824 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.157782 Sep 11 15:19:09.856613 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 330/660] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:09 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:10.879966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:10.880606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:10.887468 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:10.887977 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:10.888410 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:10.889125 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:10.889610 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:10.890027 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:11.032619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:11.043325 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-44c81a2a-e4fd-4abf-ad41-3dc7c1cdcac4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.167404 Sep 11 15:19:11.043898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 331/661] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:10 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:12.070674 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:12.071455 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:12.080690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:12.081170 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:12.081614 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:12.082302 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:12.082746 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:12.083160 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:12.220992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:12.229684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0224d750-a8e0-4404-8511-03c7045d1e03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.165202 Sep 11 15:19:12.230283 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 331/662] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:12 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:13.253391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:13.254003 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:13.261255 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:13.261742 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:13.262189 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:13.262883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:13.263337 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:13.263753 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:13.400404 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:13.409874 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-abb71d45-bb7f-4908-9cf6-fd8be42bb8a2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.160458 Sep 11 15:19:13.410521 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 332/663] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:13 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:14.441783 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:14.442690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:14.445052 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=28 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:19:14.450679 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:14.451162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:14.451588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:14.452282 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:14.452728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:14.453164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:14.456030 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:19:14.591248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:14.600696 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-44a9af00-1633-42e9-9505-b6c610580780 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.166631 Sep 11 15:19:14.601272 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 332/664] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:14 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:15.624705 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:15.625354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:15.632378 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:15.632855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:15.633312 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:15.633997 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:15.634437 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:15.634848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:15.786852 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:15.797683 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-300908e3-cbaf-4d31-bccc-cb9ed6046fd5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.176973 Sep 11 15:19:15.798420 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 333/665] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:15 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:16.821488 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:16.822100 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:16.828981 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:16.829479 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:16.829914 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:16.830612 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:16.831062 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:16.831476 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:16.986113 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:16.994790 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-eeb061ef-1c1e-4176-b1b1-bb0edef04910 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.177233 Sep 11 15:19:16.995369 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 333/666] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:16 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:18.020322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:18.020934 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:18.029396 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:18.029882 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:18.030312 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:18.031009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:18.031454 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:18.031901 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:18.059826 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8a9fd9d4-b933-4379-a33f-f1eadd8100c4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:18.061992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8a9fd9d4-b933-4379-a33f-f1eadd8100c4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:18.068940 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a9fd9d4-b933-4379-a33f-f1eadd8100c4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:18.069449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a9fd9d4-b933-4379-a33f-f1eadd8100c4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:18.069919 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a9fd9d4-b933-4379-a33f-f1eadd8100c4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:18.070764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a9fd9d4-b933-4379-a33f-f1eadd8100c4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:18.071388 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a9fd9d4-b933-4379-a33f-f1eadd8100c4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:18.071988 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a9fd9d4-b933-4379-a33f-f1eadd8100c4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:18.111940 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8a9fd9d4-b933-4379-a33f-f1eadd8100c4 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055747 Sep 11 15:19:18.114400 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 334/667] 10.222.0.44 () {60 vars in 1343 bytes} [Sun Sep 11 15:19:18 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:18.179718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:18.180409 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:18.184572 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:18.186835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:18.187324 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:18.187753 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:18.188645 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:18.189481 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:18.190129 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:18.197044 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-999e062a-551e-4829-901d-2d955f469d65 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.181297 Sep 11 15:19:18.197044 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 334/668] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:18 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:18.220770 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:19:18.302651 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b076a4ce-8886-4f94-a4df-7a4186884730 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 204 len: 0 microversion: 2.20 time: 0.126772 Sep 11 15:19:18.303289 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 335/669] 10.222.0.44 () {60 vars in 1280 bytes} [Sun Sep 11 15:19:18 2022] DELETE /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 11 15:19:18.312878 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:18.313503 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:18.315749 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=24 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:19:18.321296 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:18.321772 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:18.322498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:18.323153 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:18.323593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:18.324002 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:18.457359 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:18.469712 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:18.471302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:18.472829 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dbc6b80b-ff57-4ab6-be0d-7f45e2bf3d28 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.164238 Sep 11 15:19:18.473850 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 335/670] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:19:18 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:19:19.225536 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:19.226270 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:19.232994 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:19.233531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:19.233968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:19.234639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:19.235116 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:19.235519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:19.387312 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:19.396140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-159c4003-bcc3-41ae-89a2-83af3a1abe34 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.177774 Sep 11 15:19:19.396734 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 336/671] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:19 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:19.501880 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:19.502498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:19.508897 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:19.509395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:19.509872 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:19.510592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:19.511030 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:19.511479 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:19.657319 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:19.665971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:19.667576 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:19.668957 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d8f85656-ebff-40e5-939e-bbd9559c9e56 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1723 microversion: 2.20 time: 0.171003 Sep 11 15:19:19.670037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 336/672] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:19:19 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:19:20.421113 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:20.422548 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:20.429296 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:20.429781 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:20.430208 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:20.430884 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:20.431521 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:20.431932 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:20.562218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:20.571135 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c0bd4d9b-2381-48e3-b0d3-2279d37a129f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.153896 Sep 11 15:19:20.571710 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 337/673] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:20 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:20.638019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-d281dda3-1f18-4d44-8bb6-ac8873671253 req-6a1347d6-f4c0-40d2-bc69-e3ddbd0c94c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ed2d84-4e3f-48cd-98a1-00bc736956fa", "name": "network-vif-deleted", "tag": "dc11bee5-2af5-4d4d-9c05-1df367d916f1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:19:20.647982 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d281dda3-1f18-4d44-8bb6-ac8873671253 req-6a1347d6-f4c0-40d2-bc69-e3ddbd0c94c4 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:20.648448 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d281dda3-1f18-4d44-8bb6-ac8873671253 req-6a1347d6-f4c0-40d2-bc69-e3ddbd0c94c4 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:20.648954 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d281dda3-1f18-4d44-8bb6-ac8873671253 req-6a1347d6-f4c0-40d2-bc69-e3ddbd0c94c4 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:20.660459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-d281dda3-1f18-4d44-8bb6-ac8873671253 req-6a1347d6-f4c0-40d2-bc69-e3ddbd0c94c4 service nova] Creating event network-vif-deleted:dc11bee5-2af5-4d4d-9c05-1df367d916f1 for instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa on hv-cinder-83976 Sep 11 15:19:20.665866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-d281dda3-1f18-4d44-8bb6-ac8873671253 req-6a1347d6-f4c0-40d2-bc69-e3ddbd0c94c4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031554 Sep 11 15:19:20.666688 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 337/674] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:20.696032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:20.697432 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:20.710114 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:20.710626 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:20.711192 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:20.711983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:20.712510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:20.712937 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:20.819770 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:20.830244 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:20.832136 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e4f8b13b66449cf849ff9cb73938c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2273d07b98054e3987568fc043597b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:20.833644 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fc9c31fd-3a48-4248-9a6a-0a347ec172c0 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 200 len: 1365 microversion: 2.20 time: 0.143152 Sep 11 15:19:20.837477 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 338/675] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:19:20 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 15:19:21.596003 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:21.597040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:21.604511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:21.605638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:21.606279 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:21.607198 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:21.607846 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:21.608616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:21.858750 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:21.859328 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:21.867036 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:21.867520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:21.867941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:21.868634 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:21.869267 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:21.869689 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:21.884952 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] HTTP exception thrown: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Request method failure captured: Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa HTTP/1.1 Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkSz-jPKw4ydAqryLH9fFmYQbx5rsFJC-Us0nk4nw8YK_PNmX-whCkkXIQVWsIddOfAt7vR-uHe0DGclszL-rZ2ZEKXegUxxmCj-2Fs2JfyAHFWmpw7atcaXEq7HI_rj2jR6PYH2PxPq0tO3eIJoTRVix1YINTPK4H90w3gnwFaV0 Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:19:21.886672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2273d07b98054e3987568fc043597b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2273d07b98054e3987568fc043597b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 5e4f8b13b66449cf849ff9cb73938c4c Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:21.888331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'd3ed2d84-4e3f-48cd-98a1-00bc736956fa'} Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:19:21.889332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:21.890802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:21.892197 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Returning 404 to user: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:19:21.892197 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-81e8138e-f084-4112-b1df-fc7c6d65d984 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 404 len: 111 microversion: 2.20 time: 0.033444 Sep 11 15:19:21.892348 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 339/676] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:19:21 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:19:21.897111 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0962f9f1-9980-476b-a91b-83772bfd2fe5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '.version_select at 0x7f3933ff7af0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:21.918539 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0962f9f1-9980-476b-a91b-83772bfd2fe5 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-150284956" status: 204 len: 0 microversion: 2.20 time: 0.025054 Sep 11 15:19:21.919144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 340/677] 10.222.0.44 () {60 vars in 1259 bytes} [Sun Sep 11 15:19:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-150284956 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 15:19:22.021673 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:22.031007 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ab6715af-b9c6-49ef-a17b-aed20c45f745 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.439856 Sep 11 15:19:22.031600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 338/678] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:21 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:23.057894 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:23.058877 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:23.070203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:23.071106 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:23.071887 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:23.073127 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:23.073826 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:23.074603 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:23.219157 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:23.227957 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4eb483a9-56bd-454f-b72f-524d7cd24354 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.176387 Sep 11 15:19:23.228547 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 341/679] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:23 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:24.253473 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:24.254151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:24.262361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:24.262865 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:24.263287 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:24.264013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:24.264610 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:24.265032 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:24.431341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:24.441382 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-35da9f1d-57cc-407a-81bc-19ab571921cd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1722 microversion: 2.1 time: 0.193212 Sep 11 15:19:24.452274 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 339/680] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:24 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:24.826772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:24.827355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:24.834716 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:24.835284 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:24.835840 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:24.836590 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:24.837047 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:24.837512 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:24.854942 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] HTTP exception thrown: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Request method failure captured: Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa HTTP/1.1 Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkSz-jPKw4ydAqryLH9fFmYQbx5rsFJC-Us0nk4nw8YK_PNmX-whCkkXIQVWsIddOfAt7vR-uHe0DGclszL-rZ2ZEKXegUxxmCj-2Fs2JfyAHFWmpw7atcaXEq7HI_rj2jR6PYH2PxPq0tO3eIJoTRVix1YINTPK4H90w3gnwFaV0 Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:19:24.856510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2273d07b98054e3987568fc043597b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2273d07b98054e3987568fc043597b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 5e4f8b13b66449cf849ff9cb73938c4c Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.858150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'd3ed2d84-4e3f-48cd-98a1-00bc736956fa'} Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:19:24.859015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.860985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.862625 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Returning 404 to user: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:19:24.862625 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-93675956-3694-497f-8c44-dd677321a296 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 404 len: 111 microversion: 2.20 time: 0.035120 Sep 11 15:19:24.862625 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 342/681] 10.222.0.44 () {60 vars in 1280 bytes} [Sun Sep 11 15:19:24 2022] DELETE /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:19:24.866900 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:24.867508 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: d3ed2d84-4e3f-48cd-98a1-00bc736956fa] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:24.873893 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:24.874381 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:24.874915 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:24.875785 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:24.876295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:24.876719 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:24.890449 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] HTTP exception thrown: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Request method failure captured: Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa HTTP/1.1 Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrkSz-jPKw4ydAqryLH9fFmYQbx5rsFJC-Us0nk4nw8YK_PNmX-whCkkXIQVWsIddOfAt7vR-uHe0DGclszL-rZ2ZEKXegUxxmCj-2Fs2JfyAHFWmpw7atcaXEq7HI_rj2jR6PYH2PxPq0tO3eIJoTRVix1YINTPK4H90w3gnwFaV0 Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:19:24.892123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2273d07b98054e3987568fc043597b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2273d07b98054e3987568fc043597b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 5e4f8b13b66449cf849ff9cb73938c4c Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.893843 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'd3ed2d84-4e3f-48cd-98a1-00bc736956fa'} Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:19:24.897907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. Sep 11 15:19:24.899306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:24.900674 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Returning 404 to user: Instance d3ed2d84-4e3f-48cd-98a1-00bc736956fa could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:19:24.900674 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-51060cda-41f9-47c7-a5d7-ba4b99548224 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa" status: 404 len: 111 microversion: 2.20 time: 0.030785 Sep 11 15:19:24.900674 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 340/682] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:19:24 2022] GET /compute/v2.1/servers/d3ed2d84-4e3f-48cd-98a1-00bc736956fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:19:25.467983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:25.468503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:25.475003 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:25.475502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:25.475934 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:25.476637 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:25.477093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:25.477550 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:25.617526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:25.628596 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c20800c8-9814-42f1-b934-218636a4b71e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1699 microversion: 2.1 time: 0.164608 Sep 11 15:19:25.629408 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 343/683] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:25 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1699 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:25.652429 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-668b5e9b-08fb-4770-a76e-963320090973 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:19:25.659972 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-668b5e9b-08fb-4770-a76e-963320090973 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:25.660465 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-668b5e9b-08fb-4770-a76e-963320090973 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:25.660903 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-668b5e9b-08fb-4770-a76e-963320090973 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:25.729187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-668b5e9b-08fb-4770-a76e-963320090973 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Going to try to start instance {{(pid=120740) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 15:19:25.782586 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-668b5e9b-08fb-4770-a76e-963320090973 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/action" status: 202 len: 0 microversion: 2.1 time: 0.134227 Sep 11 15:19:25.783355 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 341/684] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:19:25 2022] POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:19:25.792976 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:25.793700 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:25.800233 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:25.800737 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:25.801220 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:25.801919 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:25.802336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:25.802797 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:25.965470 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:25.976636 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a42284ac-1537-4ef6-af50-045e15734dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1708 microversion: 2.1 time: 0.188137 Sep 11 15:19:25.977283 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 344/685] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:25 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1708 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:19:26.041966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:26.042547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:26.048899 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:26.049479 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:26.050291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:26.050889 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:26.051473 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:26.051914 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:26.069032 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] HTTP exception thrown: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Request method failure captured: Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 HTTP/1.1 Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfrkSz-jPKw4ydAqryLH9fFmYQbx5rsFJC-Us0nk4nw8YK_PNmX-whCkkXIQVWsIddOfAt7vR-uHe0DGclszL-rZ2ZEKXegUxxmCj-2Fs2JfyAHFWmpw7atcaXEq7HI_rj2jR6PYH2PxPq0tO3eIJoTRVix1YINTPK4H90w3gnwFaV0 Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:19:26.070730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2273d07b98054e3987568fc043597b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2273d07b98054e3987568fc043597b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 5e4f8b13b66449cf849ff9cb73938c4c Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.072395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8'} Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:19:26.073322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.074801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.076321 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Returning 404 to user: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:19:26.076321 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f503ed88-2ade-45f8-8686-d748c0bba020 tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "DELETE /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 404 len: 111 microversion: 2.20 time: 0.035812 Sep 11 15:19:26.078195 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 342/686] 10.222.0.44 () {60 vars in 1280 bytes} [Sun Sep 11 15:19:26 2022] DELETE /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 15:19:26.083616 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:26.084269 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] [instance: 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:26.090983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:26.091619 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:26.092061 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:26.092761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:26.093253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:26.093659 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:26.108731 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] HTTP exception thrown: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Request method failure captured: Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 HTTP/1.1 Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfrkSz-jPKw4ydAqryLH9fFmYQbx5rsFJC-Us0nk4nw8YK_PNmX-whCkkXIQVWsIddOfAt7vR-uHe0DGclszL-rZ2ZEKXegUxxmCj-2Fs2JfyAHFWmpw7atcaXEq7HI_rj2jR6PYH2PxPq0tO3eIJoTRVix1YINTPK4H90w3gnwFaV0 Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:19:26.110326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2273d07b98054e3987568fc043597b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2273d07b98054e3987568fc043597b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2273d07b98054e3987568fc043597b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 2273d07b98054e3987568fc043597b78 Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-454860976 Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 5e4f8b13b66449cf849ff9cb73938c4c Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-454860976-project Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.112056 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8'} Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:19:26.113008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. Sep 11 15:19:26.114450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:26.115795 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] Returning 404 to user: Instance 35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:19:26.115795 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3670d44a-e4a4-406d-b392-7b7c42211bed tempest-AttachVolumeShelveTestJSON-454860976 tempest-AttachVolumeShelveTestJSON-454860976-project] 10.222.0.44 "GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8" status: 404 len: 111 microversion: 2.20 time: 0.032519 Sep 11 15:19:26.116067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 345/687] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 15:19:26 2022] GET /compute/v2.1/servers/35eeeef7-ad4d-4e38-8f8f-e51d0f2068c8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 11 15:19:27.004392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:27.013711 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:27.013711 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:27.013711 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:27.013711 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:27.014211 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:27.014652 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:27.015072 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:27.223068 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:27.233877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5475ca99-92df-44d3-a7d5-30980eb36f5c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1708 microversion: 2.1 time: 0.233563 Sep 11 15:19:27.234547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 343/688] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:26 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1708 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:19:28.259737 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:28.260544 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:19:28.267757 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:28.268499 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:28.269113 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:28.270212 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:19:28.270480 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:19:28.271691 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:19:28.509371 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:19:28.522441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3cd65945-c5d3-4042-959f-fb9c1d320dca tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1712 microversion: 2.1 time: 0.268126 Sep 11 15:19:28.522957 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 346/689] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:19:28 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1712 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:19:31.330168 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3dd12832-30c2-4220-9bc0-9ec152b53ed2 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Action: 'create', calling method: .version_select at 0x7f3933f09d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1557923843"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:19:31.683609 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3dd12832-30c2-4220-9bc0-9ec152b53ed2 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.491465 Sep 11 15:19:31.684558 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 344/690] 10.222.0.44 () {60 vars in 1155 bytes} [Sun Sep 11 15:19:31 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 493 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 15:19:31.709426 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-12e70c59-184e-4eaf-889a-548b6da68f7c tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f5de50>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:31.779519 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-12e70c59-184e-4eaf-889a-548b6da68f7c tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e" status: 200 len: 345 microversion: 2.1 time: 0.075853 Sep 11 15:19:31.780611 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 347/691] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:19:31 2022] GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:32.795091 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7134e7f4-5b76-44ff-b7e2-f286c24cf22b tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3938039550>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:32.846176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7134e7f4-5b76-44ff-b7e2-f286c24cf22b tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e" status: 200 len: 346 microversion: 2.1 time: 0.055449 Sep 11 15:19:32.846728 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 345/692] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:19:32 2022] GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:32.865975 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-30e3c656-c372-44d4-b88f-9b0da95d0c53 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Action: 'create', calling method: .version_select at 0x7f3933ee5b80>, body: {"snapshot": {"volume_id": "ad7d6ecf-27ce-4b85-8484-d098150bc12e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-418240588"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:19:33.044502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-30e3c656-c372-44d4-b88f-9b0da95d0c53 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.183675 Sep 11 15:19:33.044502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 348/693] 10.222.0.44 () {60 vars in 1162 bytes} [Sun Sep 11 15:19:32 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:33.055591 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9080b3b5-cd2f-4776-ba16-68ee513d67ea tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f15280>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:33.085614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9080b3b5-cd2f-4776-ba16-68ee513d67ea tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 200 len: 286 microversion: 2.1 time: 0.034428 Sep 11 15:19:33.086179 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 346/694] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 15:19:33 2022] GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:33.097970 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4927d10f-53cf-4bde-b559-2da28c8c94ea tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f13d30>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:33.132471 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4927d10f-53cf-4bde-b559-2da28c8c94ea tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038925 Sep 11 15:19:33.133032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 349/695] 10.222.0.44 () {58 vars in 1140 bytes} [Sun Sep 11 15:19:33 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:19:33.146385 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4277b44d-3401-46cc-8c1b-d3ea97fe9417 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f9d280>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:33.177451 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4277b44d-3401-46cc-8c1b-d3ea97fe9417 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 200 len: 286 microversion: 2.1 time: 0.034942 Sep 11 15:19:33.178041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 347/696] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 15:19:33 2022] GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:19:34.194158 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-99b6a308-33e7-41ee-bb76-bbaaf7a7e917 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933ee5ca0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:34.225105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-99b6a308-33e7-41ee-bb76-bbaaf7a7e917 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 200 len: 286 microversion: 2.1 time: 0.036955 Sep 11 15:19:34.225697 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 350/697] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 15:19:34 2022] GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:35.240959 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ce9538b-34db-49fa-9d03-76740bee240e tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f07b80>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:35.275280 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8ce9538b-34db-49fa-9d03-76740bee240e tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 200 len: 286 microversion: 2.1 time: 0.040309 Sep 11 15:19:35.275859 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 348/698] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 15:19:35 2022] GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:36.288646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-578fa175-01a5-4cad-bb5b-55106eee408f tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f5de50>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:36.321115 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-578fa175-01a5-4cad-bb5b-55106eee408f tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 200 len: 286 microversion: 2.1 time: 0.036657 Sep 11 15:19:36.321699 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 351/699] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 15:19:36 2022] GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:37.333687 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=17 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:19:37.334659 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:19:37.339018 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27ef1ae8-4259-40f2-b870-6af4a22c0d82 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f9d040>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:37.370229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-27ef1ae8-4259-40f2-b870-6af4a22c0d82 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 200 len: 286 microversion: 2.1 time: 0.039274 Sep 11 15:19:37.370789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 349/700] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 15:19:37 2022] GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:38.384057 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:19:38.389127 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-17f53d1e-1daf-4893-8e49-316108e1d323 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f6f3a0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:38.422695 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-17f53d1e-1daf-4893-8e49-316108e1d323 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 200 len: 287 microversion: 2.1 time: 0.040877 Sep 11 15:19:38.423346 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 352/701] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 15:19:38 2022] GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:38.436945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4f0e0377-e34e-45a1-aa2b-edc0c6e9af9e tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f273a0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:38.499365 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4f0e0377-e34e-45a1-aa2b-edc0c6e9af9e tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 202 len: 0 microversion: 2.1 time: 0.066698 Sep 11 15:19:38.499928 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 350/702] 10.222.0.44 () {58 vars in 1254 bytes} [Sun Sep 11 15:19:38 2022] DELETE /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 15:19:38.509969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-374ca24b-b76a-4d51-b4d1-77cba0f11b39 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f39380a9e50>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:38.516371 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:19:38.541058 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-374ca24b-b76a-4d51-b4d1-77cba0f11b39 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 200 len: 286 microversion: 2.1 time: 0.035206 Sep 11 15:19:38.541653 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 353/703] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 15:19:38 2022] GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:39.555457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-533a2655-372c-410e-b307-009d010c298d tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f73c10>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:39.586811 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-533a2655-372c-410e-b307-009d010c298d tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] HTTP exception thrown: Snapshot fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a could not be found. Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-533a2655-372c-410e-b307-009d010c298d tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Request method failure captured: Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a HTTP/1.1 Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfyDezS-q3MCOuY3G6oucZCmH0y8ExCyn4gW0vBJLce_NsArZ8LWatIM9bfjRGIogMrvDDWiQ6ahGYM4ydroIYmqq3hxVP-uFH2WiMtEkiSUZZdKB51LGTcbyPH8A0WFZYJl14kowVDgui-wrki-k6BxeTxTZv521Gf3K2uFl4RMXk4 Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 54bb4955000143f480eadeca634a8dd7 Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:19:39.590634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_54bb4955000143f480eadeca634a8dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 54bb4955000143f480eadeca634a8dd7 Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesSnapshotsTestJSON-615631208-project Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 2783fecdbf6b475fb5ae16006df95dd1 Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-615631208-project Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Snapshot fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a could not be found. Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a'} Sep 11 15:19:39.592284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a could not be found. (HTTP 404) (Request-ID: req-f28d36da-3aa8-4a96-8a6d-a359807e4cfa) Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:39.593361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:19:39.594789 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a could not be found. Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 11 15:19:39.596037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a could not be found. Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a could not be found. Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-533a2655-372c-410e-b307-009d010c298d tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Returning 404 to user: Snapshot fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-533a2655-372c-410e-b307-009d010c298d tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a" status: 404 len: 111 microversion: 2.1 time: 0.042148 Sep 11 15:19:39.597288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 351/704] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 15:19:39 2022] GET /compute/v2.1/os-snapshots/fcd9e68b-4dbd-42e4-a4bd-cc7e1308270a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:19:39.604772 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-86c66378-86a6-4c11-ba62-1c34dc1ffe2c tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3938092a60>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:39.675195 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-86c66378-86a6-4c11-ba62-1c34dc1ffe2c tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e" status: 202 len: 0 microversion: 2.1 time: 0.074893 Sep 11 15:19:39.679174 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 354/705] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:19:39 2022] DELETE /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:19:39.690606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-58b47739-fc78-46f6-b0cd-5ebcd9e3f8ab tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f39380744c0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:39.757727 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-58b47739-fc78-46f6-b0cd-5ebcd9e3f8ab tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e" status: 200 len: 345 microversion: 2.1 time: 0.076157 Sep 11 15:19:39.758287 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 352/706] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:19:39 2022] GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:19:40.775596 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d0ae71e4-3a34-462d-bd03-c6ee8128ba93 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f6fa60>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:40.810547 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-d0ae71e4-3a34-462d-bd03-c6ee8128ba93 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] HTTP exception thrown: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d0ae71e4-3a34-462d-bd03-c6ee8128ba93 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Request method failure captured: Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e HTTP/1.1 Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfyDezS-q3MCOuY3G6oucZCmH0y8ExCyn4gW0vBJLce_NsArZ8LWatIM9bfjRGIogMrvDDWiQ6ahGYM4ydroIYmqq3hxVP-uFH2WiMtEkiSUZZdKB51LGTcbyPH8A0WFZYJl14kowVDgui-wrki-k6BxeTxTZv521Gf3K2uFl4RMXk4 Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 54bb4955000143f480eadeca634a8dd7 Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:19:40.814218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_54bb4955000143f480eadeca634a8dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 54bb4955000143f480eadeca634a8dd7 Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotsTestJSON-615631208-project Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 2783fecdbf6b475fb5ae16006df95dd1 Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-615631208-project Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'ad7d6ecf-27ce-4b85-8484-d098150bc12e'} Sep 11 15:19:40.816588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. (HTTP 404) (Request-ID: req-ab1070f8-6fa7-4f06-8dce-9add689111b5) Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:40.817807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:19:40.818997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 15:19:40.821011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d0ae71e4-3a34-462d-bd03-c6ee8128ba93 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Returning 404 to user: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d0ae71e4-3a34-462d-bd03-c6ee8128ba93 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e" status: 404 len: 109 microversion: 2.1 time: 0.044599 Sep 11 15:19:40.822334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 355/707] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:19:40 2022] GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:19:40.830958 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bd3b783d-d288-4582-858e-9825d90292eb tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f9d160>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:40.861981 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-bd3b783d-d288-4582-858e-9825d90292eb tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] HTTP exception thrown: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bd3b783d-d288-4582-858e-9825d90292eb tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Request method failure captured: Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e HTTP/1.1 Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfyDezS-q3MCOuY3G6oucZCmH0y8ExCyn4gW0vBJLce_NsArZ8LWatIM9bfjRGIogMrvDDWiQ6ahGYM4ydroIYmqq3hxVP-uFH2WiMtEkiSUZZdKB51LGTcbyPH8A0WFZYJl14kowVDgui-wrki-k6BxeTxTZv521Gf3K2uFl4RMXk4 Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 54bb4955000143f480eadeca634a8dd7 Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:19:40.863960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_54bb4955000143f480eadeca634a8dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 54bb4955000143f480eadeca634a8dd7 Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesSnapshotsTestJSON-615631208-project Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 2783fecdbf6b475fb5ae16006df95dd1 Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-615631208-project Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'ad7d6ecf-27ce-4b85-8484-d098150bc12e'} Sep 11 15:19:40.866315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. (HTTP 404) (Request-ID: req-abf9d084-7165-4442-bc3c-4e36273121a2) Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:40.867660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 15:19:40.869762 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 15:19:40.871945 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bd3b783d-d288-4582-858e-9825d90292eb tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Returning 404 to user: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bd3b783d-d288-4582-858e-9825d90292eb tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e" status: 404 len: 109 microversion: 2.1 time: 0.039485 Sep 11 15:19:40.873295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 353/708] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:19:40 2022] DELETE /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:19:40.879411 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f2c14a71-a51c-4c29-85e5-ca7684ec9e50 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Calling method '.version_select at 0x7f3933f6f160>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:19:40.908841 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-f2c14a71-a51c-4c29-85e5-ca7684ec9e50 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] HTTP exception thrown: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f2c14a71-a51c-4c29-85e5-ca7684ec9e50 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Request method failure captured: Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e HTTP/1.1 Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfyDezS-q3MCOuY3G6oucZCmH0y8ExCyn4gW0vBJLce_NsArZ8LWatIM9bfjRGIogMrvDDWiQ6ahGYM4ydroIYmqq3hxVP-uFH2WiMtEkiSUZZdKB51LGTcbyPH8A0WFZYJl14kowVDgui-wrki-k6BxeTxTZv521Gf3K2uFl4RMXk4 Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 54bb4955000143f480eadeca634a8dd7 Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:19:40.911034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_54bb4955000143f480eadeca634a8dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/54bb4955000143f480eadeca634a8dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 54bb4955000143f480eadeca634a8dd7 Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-615631208 Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotsTestJSON-615631208-project Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 2783fecdbf6b475fb5ae16006df95dd1 Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-615631208-project Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'ad7d6ecf-27ce-4b85-8484-d098150bc12e'} Sep 11 15:19:40.912969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. (HTTP 404) (Request-ID: req-54917fae-0b4a-4f97-a304-3a49fccb49b4) Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:40.914933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 15:19:40.916093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 15:19:40.917253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f2c14a71-a51c-4c29-85e5-ca7684ec9e50 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] Returning 404 to user: Volume ad7d6ecf-27ce-4b85-8484-d098150bc12e could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f2c14a71-a51c-4c29-85e5-ca7684ec9e50 tempest-VolumesSnapshotsTestJSON-615631208 tempest-VolumesSnapshotsTestJSON-615631208-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e" status: 404 len: 109 microversion: 2.1 time: 0.037041 Sep 11 15:19:40.918375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 356/709] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 15:19:40 2022] GET /compute/v2.1/os-volumes/ad7d6ecf-27ce-4b85-8484-d098150bc12e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:20:00.679460 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-568896045", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "networks": [{"uuid": "9a803089-7f91-4f56-84e7-2ad063e351e7"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:00.741886 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] validate_networks() for [('9a803089-7f91-4f56-84e7-2ad063e351e7', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:20:01.195304 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:01.196125 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:01.206820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:01.207542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:01.208212 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:01.209411 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:01.210180 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:01.210825 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:01.276134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:20:01.276134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:20:01.276134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:20:01.276134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:20:01.276134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:20:01.291384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:01.292218 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:01.292932 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:01.294269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:01.295046 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:01.295707 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:01.326534 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Getting quotas for project 8b5fece5b881463091697f7dbe3988f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:20:01.334318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Getting quotas for user b2b5486855554f388e6ee753e748161b and project 8b5fece5b881463091697f7dbe3988f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:20:01.337415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lazy-loading 'services' on Instance uuid 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:20:01.348910 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:20:01.351517 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:20:01.402680 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7356f63b-972f-461a-a4b4-d7de618506bf tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728561 Sep 11 15:20:01.403717 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 354/710] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:20:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:20:01.425050 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-efc7072b-1118-4bf4-b872-11ac54843a13 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:01.426116 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-efc7072b-1118-4bf4-b872-11ac54843a13 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:01.443995 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1f6fa335-e3fa-476e-b2c5-49f651592de6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "DELETE /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/os-volume_attachments/bcbf2db0-2106-49fd-9b93-d945b70f9947" status: 202 len: 0 microversion: 2.1 time: 0.258959 Sep 11 15:20:01.445983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 357/711] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:20:01 2022] DELETE /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/os-volume_attachments/bcbf2db0-2106-49fd-9b93-d945b70f9947 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 15:20:01.519617 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-efc7072b-1118-4bf4-b872-11ac54843a13 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:01.528024 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-efc7072b-1118-4bf4-b872-11ac54843a13 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1213 microversion: 2.1 time: 0.110420 Sep 11 15:20:01.528616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 355/712] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:01 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:02.556410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:02.557362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:02.565102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:02.566007 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:02.566624 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:02.567259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:02.567873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:02.568344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:02.626053 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-319657ba-8a8d-4c4d-acc6-6ddf613790e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:02.634821 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-319657ba-8a8d-4c4d-acc6-6ddf613790e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:02.635661 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-319657ba-8a8d-4c4d-acc6-6ddf613790e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:02.636262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-319657ba-8a8d-4c4d-acc6-6ddf613790e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:02.678628 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-319657ba-8a8d-4c4d-acc6-6ddf613790e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Going to try to stop instance {{(pid=120740) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 15:20:02.679849 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:02.691770 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1cbf9891-f703-49f6-8c9f-94eb11899571 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1273 microversion: 2.1 time: 0.142901 Sep 11 15:20:02.692863 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 358/713] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:02 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:02.734345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-319657ba-8a8d-4c4d-acc6-6ddf613790e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/action" status: 202 len: 0 microversion: 2.1 time: 0.111999 Sep 11 15:20:02.735200 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 356/714] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:20:02 2022] POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 15:20:02.748046 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:02.748611 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:02.755224 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:02.756143 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:02.756828 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:02.757856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:02.758794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:02.759440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:02.926895 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:02.945193 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b99fe98b-e9c1-4635-8ca8-f90657a0a823 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.204263 Sep 11 15:20:02.946486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 359/715] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:02 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:03.729417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:03.730008 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:03.736752 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:03.737262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:03.737691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:03.738387 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:03.738866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:03.739264 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:03.883974 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:03.891723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2b578f17-11ab-466d-94d5-8d5d6dfd6eee tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1313 microversion: 2.1 time: 0.167253 Sep 11 15:20:03.892307 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 357/716] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:03 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:03.971520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:03.972229 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:03.980407 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:03.981224 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:03.981546 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:03.982286 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:03.982752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:03.983315 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:04.122443 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:04.130957 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-83f15cd4-52cf-4ea4-9701-95f08096aa73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.163292 Sep 11 15:20:04.145171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 360/717] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:03 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:04.157263 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-1c60a77c-1d64-4f08-a75b-e172a5147d74 req-86644c97-188d-48db-8162-0389d22e5b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8adbfa44-9736-4989-8179-5ff646e05c6e", "tag": "78afc538-7b00-42fa-91d1-9ac20273a458"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:04.167286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-1c60a77c-1d64-4f08-a75b-e172a5147d74 req-86644c97-188d-48db-8162-0389d22e5b53 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:04.167848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-1c60a77c-1d64-4f08-a75b-e172a5147d74 req-86644c97-188d-48db-8162-0389d22e5b53 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:04.168278 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-1c60a77c-1d64-4f08-a75b-e172a5147d74 req-86644c97-188d-48db-8162-0389d22e5b53 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:04.181505 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-1c60a77c-1d64-4f08-a75b-e172a5147d74 req-86644c97-188d-48db-8162-0389d22e5b53 service nova] Creating event network-changed:78afc538-7b00-42fa-91d1-9ac20273a458 for instance 8adbfa44-9736-4989-8179-5ff646e05c6e on hv-cinder-83976 Sep 11 15:20:04.186198 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-1c60a77c-1d64-4f08-a75b-e172a5147d74 req-86644c97-188d-48db-8162-0389d22e5b53 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032679 Sep 11 15:20:04.187152 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 358/718] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:20:04.916716 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:04.917259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:04.924072 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:04.924560 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:04.924983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:04.925686 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:04.926141 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:04.926554 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:05.068023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:05.077723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-00d237cb-fdad-4fb2-92f2-07c8c1140302 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1313 microversion: 2.1 time: 0.164998 Sep 11 15:20:05.078280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 361/719] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:04 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:05.157357 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:05.158052 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:05.165085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:05.165595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:05.166081 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:05.166849 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:05.167235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:05.167652 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:05.306574 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:05.315338 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c58b18e2-972d-42da-a933-e05eb7a03719 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.163407 Sep 11 15:20:05.315966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 359/720] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:05 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:06.100389 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:06.100946 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:06.107836 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:06.108329 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:06.108763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:06.109488 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:06.109942 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:06.110364 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:06.255040 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:06.264289 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d1731de4-9b5e-490b-a8a5-cfee1403c067 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1313 microversion: 2.1 time: 0.167836 Sep 11 15:20:06.264864 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 362/721] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:06 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:06.342163 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:06.342832 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:06.351532 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:06.351942 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:06.352514 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:06.353602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:06.354080 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:06.354501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:06.502991 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:06.514367 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f03f0db3-b6b6-42c4-9eae-e62e0ecfe716 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.178457 Sep 11 15:20:06.514904 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 360/722] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:06 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:07.287532 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:07.288240 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:07.295211 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:07.295713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:07.296138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:07.296870 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:07.297479 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:07.297933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:07.439142 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:07.447036 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e00469c2-7e5f-424b-9491-ac96824a2ed3 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1313 microversion: 2.1 time: 0.163435 Sep 11 15:20:07.447598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 363/723] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:07 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:20:07.538766 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:07.539457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:07.546334 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:07.546769 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:07.547208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:07.547904 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:07.548352 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:07.548757 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:07.690983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:07.698948 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-09786d3e-3ed5-4f4a-908c-3859c8caac3b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.164200 Sep 11 15:20:07.699531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 361/724] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:07 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:08.474567 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:08.475440 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:08.482538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:08.482998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:08.483439 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:08.484162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:08.484612 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:08.485081 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:08.631929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:08.640100 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f267bd50-0c84-4eac-a8d2-6046026fe52b tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1313 microversion: 2.1 time: 0.169522 Sep 11 15:20:08.640715 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 364/725] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:08 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:08.722635 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:08.723253 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:08.730077 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:08.730560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:08.730989 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:08.731683 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:08.732116 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:08.732527 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:08.879559 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:08.891666 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-652d346c-792b-408b-8eed-81e3359f692d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.172935 Sep 11 15:20:08.892268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 362/726] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:08 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:09.267546 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-66168c41-b293-4c09-aa52-a305d31ffe4a req-96ffcf8a-967f-4391-acdc-47fc744cfddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adbfa44-9736-4989-8179-5ff646e05c6e", "name": "network-vif-plugged", "status": "completed", "tag": "78afc538-7b00-42fa-91d1-9ac20273a458"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:09.280219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-66168c41-b293-4c09-aa52-a305d31ffe4a req-96ffcf8a-967f-4391-acdc-47fc744cfddd service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:09.280219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-66168c41-b293-4c09-aa52-a305d31ffe4a req-96ffcf8a-967f-4391-acdc-47fc744cfddd service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:09.280219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-66168c41-b293-4c09-aa52-a305d31ffe4a req-96ffcf8a-967f-4391-acdc-47fc744cfddd service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:09.291448 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-66168c41-b293-4c09-aa52-a305d31ffe4a req-96ffcf8a-967f-4391-acdc-47fc744cfddd service nova] Creating event network-vif-plugged:78afc538-7b00-42fa-91d1-9ac20273a458 for instance 8adbfa44-9736-4989-8179-5ff646e05c6e on hv-cinder-83976 Sep 11 15:20:09.296653 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-66168c41-b293-4c09-aa52-a305d31ffe4a req-96ffcf8a-967f-4391-acdc-47fc744cfddd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 Sep 11 15:20:09.297329 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 365/727] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:20:09.662745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:09.663351 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:09.669961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:09.670447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:09.670879 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:09.671602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:09.672040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:09.672490 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:09.813931 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:09.829015 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f4edfead-bd8a-4ea0-a7b4-3800351937bc tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1313 microversion: 2.1 time: 0.169801 Sep 11 15:20:09.830094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 363/728] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:09 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:09.917284 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:09.918232 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:09.926373 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:09.926853 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:09.927282 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:09.927965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:09.928431 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:09.928846 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:10.078537 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:10.090918 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1f7b5b06-478a-4702-9003-6c4d08c1beb1 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.178284 Sep 11 15:20:10.091520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 366/729] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:09 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:10.857418 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:10.858076 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:10.865273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:10.865734 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:10.866175 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:10.866864 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:10.867305 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:10.867724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:11.018470 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:11.028635 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fdf1d102-6108-4026-8060-b2d78c33e507 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1313 microversion: 2.1 time: 0.177367 Sep 11 15:20:11.029254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 364/730] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:10 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:11.114969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:11.115585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:11.122332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:11.122807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:11.123227 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:11.123909 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:11.124356 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:11.124729 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:11.275604 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:11.284190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4e30ccf1-b916-486b-b2ef-0c1cf6fbd0e4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.173125 Sep 11 15:20:11.284774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 367/731] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:11 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:12.052056 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:12.052681 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:12.054733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:12.055423 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=8 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:12.063026 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:12.063538 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:12.063970 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:12.064761 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:12.065209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:12.065622 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:12.211097 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:12.220104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7b01f787-25f0-41c3-af81-c33266fcbe38 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1496 microversion: 2.1 time: 0.172219 Sep 11 15:20:12.220748 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 365/732] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:12 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1496 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:12.308615 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:12.309353 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:12.316953 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:12.317464 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:12.317910 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:12.318717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:12.319252 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:12.319718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:12.489261 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:12.499955 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6ee6a81a-7e5d-43fd-b00d-055e8f68f86b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.194214 Sep 11 15:20:12.499955 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 368/733] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:12 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:12.670849 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:12.671262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:12.677876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:12.678366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:12.678797 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:12.679501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:12.679947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:12.680390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:12.713084 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:20:12.809276 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1bc83cb9-4aff-489f-808b-1fa3cd203e2e tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 204 len: 0 microversion: 2.1 time: 0.141852 Sep 11 15:20:12.810049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 366/734] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:20:12 2022] DELETE /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:20:12.819763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:12.820385 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:12.826958 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:12.827448 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:12.827882 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:12.828588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:12.829058 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:12.829495 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:12.981302 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:12.989739 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c2efcab7-4089-4ba8-980e-3e7a59026e16 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1502 microversion: 2.1 time: 0.174335 Sep 11 15:20:12.990331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 369/735] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:12 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:13.535153 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:13.535805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:13.542987 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:13.543469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:13.543932 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:13.544625 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:13.545076 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:13.545532 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:13.689090 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:13.701399 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f0d8ee8e-4240-4c7b-ad7a-4d882b2a3eec tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1676 microversion: 2.1 time: 0.170369 Sep 11 15:20:13.702131 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 367/736] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:13 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:20:14.017820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:14.018433 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:14.026427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:14.027164 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:14.027880 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:14.028856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:14.029594 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:14.030307 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:14.193622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:14.203459 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9eaeaa18-376e-43be-92b7-6c3d23493b53 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 200 len: 1502 microversion: 2.1 time: 0.189562 Sep 11 15:20:14.204157 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 370/737] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:14 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:14.602867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-63a60cfa-d9c4-4448-8512-af6e88355f71 req-29f070c9-7253-4366-b825-4c9aef7a0670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adbfa44-9736-4989-8179-5ff646e05c6e", "name": "network-vif-deleted", "tag": "78afc538-7b00-42fa-91d1-9ac20273a458"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:14.613068 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-63a60cfa-d9c4-4448-8512-af6e88355f71 req-29f070c9-7253-4366-b825-4c9aef7a0670 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:14.613603 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-63a60cfa-d9c4-4448-8512-af6e88355f71 req-29f070c9-7253-4366-b825-4c9aef7a0670 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:14.614008 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-63a60cfa-d9c4-4448-8512-af6e88355f71 req-29f070c9-7253-4366-b825-4c9aef7a0670 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:14.625447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-63a60cfa-d9c4-4448-8512-af6e88355f71 req-29f070c9-7253-4366-b825-4c9aef7a0670 service nova] Creating event network-vif-deleted:78afc538-7b00-42fa-91d1-9ac20273a458 for instance 8adbfa44-9736-4989-8179-5ff646e05c6e on hv-cinder-83976 Sep 11 15:20:14.630283 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-63a60cfa-d9c4-4448-8512-af6e88355f71 req-29f070c9-7253-4366-b825-4c9aef7a0670 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031130 Sep 11 15:20:14.630885 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 368/738] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:20:14.732372 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:14.732991 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:14.740205 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:14.740635 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:14.741173 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:14.741906 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:14.742255 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:14.743132 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:14.888764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:14.898539 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b5d5460b-c2c0-4ee0-b40e-9735c987fce0 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1653 microversion: 2.1 time: 0.169958 Sep 11 15:20:14.899308 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 371/739] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:14 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1653 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:14.924769 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b78bb24c-394f-4036-8833-f1e83e21a912 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:14.931550 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b78bb24c-394f-4036-8833-f1e83e21a912 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:14.932033 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b78bb24c-394f-4036-8833-f1e83e21a912 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:14.932461 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b78bb24c-394f-4036-8833-f1e83e21a912 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:14.957029 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b78bb24c-394f-4036-8833-f1e83e21a912 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Going to try to start instance {{(pid=120740) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 15:20:14.994391 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:15.004764 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b78bb24c-394f-4036-8833-f1e83e21a912 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/action" status: 202 len: 0 microversion: 2.1 time: 0.084238 Sep 11 15:20:15.005421 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 369/740] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:20:14 2022] POST /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:20:15.016070 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:15.016792 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:15.024399 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:15.025044 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:15.025675 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:15.026613 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:15.027196 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:15.027796 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:15.232142 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:15.233532 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 8adbfa44-9736-4989-8179-5ff646e05c6e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:15.243536 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:15.244025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:15.244500 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:15.245235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:15.245864 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:15.246286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:15.262511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] HTTP exception thrown: Instance 8adbfa44-9736-4989-8179-5ff646e05c6e could not be found. Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Request method failure captured: Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e HTTP/1.1 Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfyey3bDsIaw_ech3qa0XNynrncPli4eozXuE7nzmZxp0mVeE1AC6pc238pMOgW6B0ksuHEYeuyp4lawv0HRn0yphsdlObGo1E-1mlh0CDhF1LGvt9RrivRIew-32mwk8Borw4ZGjBtDrZ_WtQnvIeeOKc6NdlaY6KGLZu-mfF7Zhm0 Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 8b5fece5b881463091697f7dbe3988f4 Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesActionsTest-2066707411 Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:20:15.264738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8b5fece5b881463091697f7dbe3988f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8b5fece5b881463091697f7dbe3988f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8b5fece5b881463091697f7dbe3988f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8b5fece5b881463091697f7dbe3988f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesActionsTest-2066707411 Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 8b5fece5b881463091697f7dbe3988f4 Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesActionsTest-2066707411 Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesActionsTest-2066707411-project Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: b2b5486855554f388e6ee753e748161b Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesActionsTest-2066707411-project Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 8adbfa44-9736-4989-8179-5ff646e05c6e could not be found. Sep 11 15:20:15.266425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '8adbfa44-9736-4989-8179-5ff646e05c6e'} Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8adbfa44-9736-4989-8179-5ff646e05c6e could not be found. Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:20:15.267288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8adbfa44-9736-4989-8179-5ff646e05c6e could not be found. Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8adbfa44-9736-4989-8179-5ff646e05c6e could not be found. Sep 11 15:20:15.268866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:20:15.270998 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Returning 404 to user: Instance 8adbfa44-9736-4989-8179-5ff646e05c6e could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:20:15.271866 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-95253aa0-e745-42eb-8c68-0cf2245703fe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e" status: 404 len: 111 microversion: 2.1 time: 0.048714 Sep 11 15:20:15.272809 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 370/741] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:15 2022] GET /compute/v2.1/servers/8adbfa44-9736-4989-8179-5ff646e05c6e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:20:15.326053 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-158846331", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "networks": [{"uuid": "9a803089-7f91-4f56-84e7-2ad063e351e7"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:15.372350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:15.381399 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-49647d14-5200-449c-96ec-8166c721b92b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1662 microversion: 2.1 time: 0.370556 Sep 11 15:20:15.381945 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 372/742] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:15 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1662 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:15.402950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] validate_networks() for [('9a803089-7f91-4f56-84e7-2ad063e351e7', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:20:15.814026 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:20:15.814972 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:20:15.815119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:20:15.815469 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:20:15.815869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:20:15.825286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:15.825674 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:15.826094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:15.826798 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:15.827235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:15.827644 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:15.849264 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Getting quotas for project 8b5fece5b881463091697f7dbe3988f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:20:15.853454 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Getting quotas for user b2b5486855554f388e6ee753e748161b and project 8b5fece5b881463091697f7dbe3988f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:20:15.864478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:20:15.866837 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:20:15.919544 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4dc38e0d-5aef-486e-a4f2-9b0ed7195a29 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597531 Sep 11 15:20:15.920238 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 371/743] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 15:20:15.931816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c90d80c1-d70f-42e7-8af3-df6ba707504d tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:15.932435 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c90d80c1-d70f-42e7-8af3-df6ba707504d tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:15.994510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c90d80c1-d70f-42e7-8af3-df6ba707504d tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:16.003115 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c90d80c1-d70f-42e7-8af3-df6ba707504d tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1213 microversion: 2.1 time: 0.075172 Sep 11 15:20:16.003700 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 373/744] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:15 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:16.405911 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:16.406539 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:16.414523 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:16.415136 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:16.415600 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:16.416373 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:16.416927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:16.417456 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:16.576715 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:16.592693 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a877a4a9-8be1-413f-8d12-a50f8dde1a49 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1662 microversion: 2.1 time: 0.190135 Sep 11 15:20:16.593684 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 372/745] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:16 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1662 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:17.029730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:17.030597 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:17.039313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:17.039828 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:17.040321 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:17.041189 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:17.041818 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:17.042240 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:17.063686 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:17.112237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:17.124281 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5ab62e3e-ef5a-4d36-bba2-8b95b350d7b0 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1265 microversion: 2.1 time: 0.100118 Sep 11 15:20:17.125336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 374/746] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:17 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:17.620743 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:17.622506 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:17.629351 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:17.630108 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:17.630778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:17.631468 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:17.631946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:17.632364 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:17.846354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:17.855877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6b8253c1-7fda-4387-9d76-b7c6ddfec492 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1666 microversion: 2.1 time: 0.239615 Sep 11 15:20:17.856482 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 373/747] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:17 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1666 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:18.159520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:18.160154 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:18.166882 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:18.167372 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:18.167801 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:18.168540 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:18.168990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:18.169442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:18.351884 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:18.362493 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-99b77d96-21cd-4b84-bab8-b2e794bc093c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1313 microversion: 2.1 time: 0.207038 Sep 11 15:20:18.363123 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 375/748] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:18 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:19.030109 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-62fd75bd-4b6d-4091-ba52-0ea02dd1b13a req-db88b824-f8ed-4623-8f63-25a79456a358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5365e7c6-b594-44f8-80e0-905eb3a08771", "tag": "08116b55-6657-46ed-9828-98cdf5c46e21"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:19.064295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-62fd75bd-4b6d-4091-ba52-0ea02dd1b13a req-db88b824-f8ed-4623-8f63-25a79456a358 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:19.073465 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-62fd75bd-4b6d-4091-ba52-0ea02dd1b13a req-db88b824-f8ed-4623-8f63-25a79456a358 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:19.074470 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-62fd75bd-4b6d-4091-ba52-0ea02dd1b13a req-db88b824-f8ed-4623-8f63-25a79456a358 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:19.093700 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-62fd75bd-4b6d-4091-ba52-0ea02dd1b13a req-db88b824-f8ed-4623-8f63-25a79456a358 service nova] Creating event network-changed:08116b55-6657-46ed-9828-98cdf5c46e21 for instance 5365e7c6-b594-44f8-80e0-905eb3a08771 on hv-cinder-83976 Sep 11 15:20:19.101538 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-62fd75bd-4b6d-4091-ba52-0ea02dd1b13a req-db88b824-f8ed-4623-8f63-25a79456a358 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078217 Sep 11 15:20:19.102442 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 374/749] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:20:19.387191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:19.387987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:19.395876 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:19.396378 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:19.396868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:19.397649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:19.398096 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:19.398521 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:19.610232 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:19.619209 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d1febcb9-e89a-4952-b053-b89d127111f8 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1313 microversion: 2.1 time: 0.236082 Sep 11 15:20:19.619794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 376/750] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:19 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:20.644148 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:20.645018 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:20.651746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:20.652240 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:20.652670 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:20.653428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:20.653888 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:20.654309 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:20.793507 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:20.801794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-557244b3-f3ec-4263-8f47-85ab3dc3c103 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1313 microversion: 2.1 time: 0.162446 Sep 11 15:20:20.802415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 375/751] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:20 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:21.825799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:21.826531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:21.833495 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:21.834046 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:21.834466 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:21.835227 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:21.835784 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:21.836197 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:21.984088 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:21.992607 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-988c519b-0b16-4868-8f66-5c7349a75ce6 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1313 microversion: 2.1 time: 0.170732 Sep 11 15:20:21.993188 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 377/752] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:21 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:23.018505 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:23.019674 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:23.030687 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:23.031544 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:23.032322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:23.033645 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:23.034461 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:23.035190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:23.189712 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:23.198013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b094f6fc-0f7e-403c-a904-f9241cf4966f tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1313 microversion: 2.1 time: 0.186316 Sep 11 15:20:23.198626 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 376/753] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:23 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:24.221964 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:24.223722 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:24.229759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:24.230265 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:24.230744 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:24.231520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:24.232050 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:24.232465 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:24.373338 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:24.381357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6450201d-e8f1-4fe7-b91c-a2264de4d729 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1313 microversion: 2.1 time: 0.163230 Sep 11 15:20:24.381915 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 378/754] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:24 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:25.351831 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-be994bcf-f7ce-4ab5-b6e9-0fc4972a6001 req-c0db67db-e67c-4519-b834-533da2076984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5365e7c6-b594-44f8-80e0-905eb3a08771", "name": "network-vif-plugged", "status": "completed", "tag": "08116b55-6657-46ed-9828-98cdf5c46e21"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:25.362902 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-be994bcf-f7ce-4ab5-b6e9-0fc4972a6001 req-c0db67db-e67c-4519-b834-533da2076984 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:25.363668 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-be994bcf-f7ce-4ab5-b6e9-0fc4972a6001 req-c0db67db-e67c-4519-b834-533da2076984 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:25.364146 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-be994bcf-f7ce-4ab5-b6e9-0fc4972a6001 req-c0db67db-e67c-4519-b834-533da2076984 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:25.375771 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-be994bcf-f7ce-4ab5-b6e9-0fc4972a6001 req-c0db67db-e67c-4519-b834-533da2076984 service nova] Creating event network-vif-plugged:08116b55-6657-46ed-9828-98cdf5c46e21 for instance 5365e7c6-b594-44f8-80e0-905eb3a08771 on hv-cinder-83976 Sep 11 15:20:25.380902 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-be994bcf-f7ce-4ab5-b6e9-0fc4972a6001 req-c0db67db-e67c-4519-b834-533da2076984 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032824 Sep 11 15:20:25.381701 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 377/755] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:20:25.404800 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:25.405964 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:25.414319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:25.415252 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:25.415743 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:25.416567 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:25.417023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:25.418690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:25.561826 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:25.570163 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c0d96518-40af-40df-8705-eb316b6f0e8c tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1313 microversion: 2.1 time: 0.170016 Sep 11 15:20:25.570783 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 379/756] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:25 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:26.590986 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:26.591688 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:26.598680 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:26.599815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:26.610506 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:26.611138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:26.611817 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:26.612498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:26.612940 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:26.613407 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:26.751776 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:26.760328 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c134a27d-fdc9-4547-b896-2f8ebc71ba75 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1313 microversion: 2.1 time: 0.170496 Sep 11 15:20:26.760922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 378/757] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:26 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:27.786016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:27.786652 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:27.788518 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:27.794637 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:27.795128 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:27.795550 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:27.796246 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:27.796690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:27.797102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:27.939945 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:27.951121 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9e8e699a-61e7-4a89-b706-8dfbe0cd9926 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1497 microversion: 2.1 time: 0.170611 Sep 11 15:20:27.951974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 380/758] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:27 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:28.439096 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:28.439726 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:28.446820 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:28.447293 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:28.447723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:28.448426 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:28.448873 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:28.449324 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:28.476199 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:20:28.562303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-def8fcdf-9d9f-4e66-ab47-5a5cfc1e6aae tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 204 len: 0 microversion: 2.1 time: 0.126777 Sep 11 15:20:28.562872 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 379/759] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:20:28 2022] DELETE /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:20:28.573278 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:28.574420 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:28.582481 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:28.582980 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:28.583414 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:28.584117 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:28.584570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:28.584993 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:28.726846 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:28.735582 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-078e31c4-ac32-49d7-bfe0-2eccf9f3bb00 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1503 microversion: 2.1 time: 0.167121 Sep 11 15:20:28.736218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 381/760] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:28 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:20:29.760092 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:29.760733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:29.767863 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:29.768353 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:29.768778 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:29.769520 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:29.769970 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:29.770382 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:29.914225 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:29.925245 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d7bfb217-410a-440f-9418-3fe540df2889 tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1503 microversion: 2.1 time: 0.169190 Sep 11 15:20:29.925845 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 380/761] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:29 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:30.454087 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-ba120427-1123-4659-91c9-5841bb6ae4de req-71f13f1e-f9bb-4e08-8dd6-bcc57f802663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5365e7c6-b594-44f8-80e0-905eb3a08771", "name": "network-vif-deleted", "tag": "08116b55-6657-46ed-9828-98cdf5c46e21"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:30.467799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ba120427-1123-4659-91c9-5841bb6ae4de req-71f13f1e-f9bb-4e08-8dd6-bcc57f802663 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:30.468421 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ba120427-1123-4659-91c9-5841bb6ae4de req-71f13f1e-f9bb-4e08-8dd6-bcc57f802663 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:30.469032 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ba120427-1123-4659-91c9-5841bb6ae4de req-71f13f1e-f9bb-4e08-8dd6-bcc57f802663 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:30.483267 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-ba120427-1123-4659-91c9-5841bb6ae4de req-71f13f1e-f9bb-4e08-8dd6-bcc57f802663 service nova] Creating event network-vif-deleted:08116b55-6657-46ed-9828-98cdf5c46e21 for instance 5365e7c6-b594-44f8-80e0-905eb3a08771 on hv-cinder-83976 Sep 11 15:20:30.488682 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-ba120427-1123-4659-91c9-5841bb6ae4de req-71f13f1e-f9bb-4e08-8dd6-bcc57f802663 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038357 Sep 11 15:20:30.489654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 382/762] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:20:30.951592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:30.952197 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:30.954720 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:30.959817 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:30.960303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:30.960728 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:30.965623 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:30.966137 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:30.966572 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:31.001292 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:31.002070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:31.002484 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:31.002925 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lazy-loading 'fault' on Instance uuid 5365e7c6-b594-44f8-80e0-905eb3a08771 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:20:31.050358 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b5486855554f388e6ee753e748161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5fece5b881463091697f7dbe3988f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:31.058050 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-22d2bce4-748e-4b23-a847-3c0c91439bbe tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 200 len: 1303 microversion: 2.1 time: 0.110317 Sep 11 15:20:31.058663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 381/763] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:30 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:32.085179 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:32.085984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] [instance: 5365e7c6-b594-44f8-80e0-905eb3a08771] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:32.089674 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=55 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:32.095823 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:32.096309 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:32.096761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:32.097504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:32.097957 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:32.098462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:32.115335 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] HTTP exception thrown: Instance 5365e7c6-b594-44f8-80e0-905eb3a08771 could not be found. Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Request method failure captured: Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 HTTP/1.1 Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfyey3bDsIaw_ech3qa0XNynrncPli4eozXuE7nzmZxp0mVeE1AC6pc238pMOgW6B0ksuHEYeuyp4lawv0HRn0yphsdlObGo1E-1mlh0CDhF1LGvt9RrivRIew-32mwk8Borw4ZGjBtDrZ_WtQnvIeeOKc6NdlaY6KGLZu-mfF7Zhm0 Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 8b5fece5b881463091697f7dbe3988f4 Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesActionsTest-2066707411 Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:20:32.117313 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8b5fece5b881463091697f7dbe3988f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8b5fece5b881463091697f7dbe3988f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8b5fece5b881463091697f7dbe3988f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8b5fece5b881463091697f7dbe3988f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesActionsTest-2066707411 Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 8b5fece5b881463091697f7dbe3988f4 Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesActionsTest-2066707411 Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesActionsTest-2066707411-project Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: b2b5486855554f388e6ee753e748161b Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesActionsTest-2066707411-project Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 5365e7c6-b594-44f8-80e0-905eb3a08771 could not be found. Sep 11 15:20:32.119360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '5365e7c6-b594-44f8-80e0-905eb3a08771'} Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5365e7c6-b594-44f8-80e0-905eb3a08771 could not be found. Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:20:32.120423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5365e7c6-b594-44f8-80e0-905eb3a08771 could not be found. Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5365e7c6-b594-44f8-80e0-905eb3a08771 could not be found. Sep 11 15:20:32.121987 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:20:32.123302 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] Returning 404 to user: Instance 5365e7c6-b594-44f8-80e0-905eb3a08771 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:20:32.123302 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ee5b0725-d87e-4b35-8cbe-973830b890ea tempest-VolumesActionsTest-2066707411 tempest-VolumesActionsTest-2066707411-project] 10.222.0.44 "GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771" status: 404 len: 111 microversion: 2.1 time: 0.039982 Sep 11 15:20:32.123302 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 383/764] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:32 2022] GET /compute/v2.1/servers/5365e7c6-b594-44f8-80e0-905eb3a08771 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:20:56.188403 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d2dfc441-77ab-4fc6-b643-d121f007e11f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:56.190736 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d2dfc441-77ab-4fc6-b643-d121f007e11f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:56.193119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:56.193831 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:56.200867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2dfc441-77ab-4fc6-b643-d121f007e11f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:56.201459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2dfc441-77ab-4fc6-b643-d121f007e11f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:56.201898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2dfc441-77ab-4fc6-b643-d121f007e11f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:56.202640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2dfc441-77ab-4fc6-b643-d121f007e11f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:56.203099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2dfc441-77ab-4fc6-b643-d121f007e11f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:56.203522 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2dfc441-77ab-4fc6-b643-d121f007e11f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:56.237008 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d2dfc441-77ab-4fc6-b643-d121f007e11f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052972 Sep 11 15:20:56.237642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 382/765] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:20:56 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 11 15:20:56.317943 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:56.318799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:56.322347 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:56.323560 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=48 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:56.332140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:56.332876 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:56.333797 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:56.334922 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:56.335720 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:56.336438 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:56.366200 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:20:56.482645 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e17aee3f-f059-4296-927a-453c607d730b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "DELETE /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 204 len: 0 microversion: 2.1 time: 0.172327 Sep 11 15:20:56.483630 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 384/766] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:20:56 2022] DELETE /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:20:56.492275 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:56.493009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:56.500160 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:56.500719 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:56.501541 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:56.502193 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:56.504817 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:56.504817 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:56.645021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:56.653459 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-834a5038-6feb-4c7a-98d3-873647db4f70 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1672 microversion: 2.1 time: 0.165920 Sep 11 15:20:56.654040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 383/767] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:56 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:57.662922 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-708351286", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:57.678572 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:57.679194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:57.687782 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:57.688801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:57.689448 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:57.690787 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:57.691713 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:57.692316 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:57.721607 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] validate_networks() for None {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:20:58.037948 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:58.046248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-48819250-e4e8-422a-b36a-fd11e540bf46 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1672 microversion: 2.1 time: 0.371860 Sep 11 15:20:58.046864 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 384/768] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:57 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1672 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:20:58.103154 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:20:58.103579 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:20:58.104075 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:20:58.104481 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:20:58.104886 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:20:58.115766 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:58.115951 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:58.116220 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:58.117221 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:58.117656 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:58.118071 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:58.136697 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Getting quotas for project ae1e34e58001410699b1cb3fd88057e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:20:58.141310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Getting quotas for user faf283b28e864d15b316edcf281e96f9 and project ae1e34e58001410699b1cb3fd88057e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:20:58.153448 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:20:58.155863 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:20:58.201069 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [6fada087-0d06-4969-8d17-c23b3065004e] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 15:20:59.071178 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:59.071887 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:59.078961 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:59.079481 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:59.079894 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:59.080664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:59.081078 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:59.081538 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:59.154620 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:59.165190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4574d46f-5db9-4239-b6ea-8a5acabc445e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1604 microversion: 2.1 time: 0.097770 Sep 11 15:20:59.166171 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 385/769] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:59 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:59.210964 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [6fada087-0d06-4969-8d17-c23b3065004e] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 34096. Sep 11 15:20:59.218386 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6f6fa08c-37df-418f-923a-d355078832bf tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.559877 Sep 11 15:20:59.219668 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 385/770] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:20:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:20:59.233505 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9093af5f-919e-4746-9d0f-88cbe16e6f6a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:20:59.245826 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9093af5f-919e-4746-9d0f-88cbe16e6f6a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:20:59.328420 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-fb33fe1f-ae0c-4406-9b3f-98a4bd206d41 req-d576d189-e735-4e72-bae4-c720c49bc068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53bf29bf-c1c3-4a06-83c2-e3eb3df12430", "name": "network-vif-deleted", "tag": "261aaf26-5f19-41e1-b97b-d37a713a7225"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:20:59.373330 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-fb33fe1f-ae0c-4406-9b3f-98a4bd206d41 req-d576d189-e735-4e72-bae4-c720c49bc068 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:20:59.374003 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-fb33fe1f-ae0c-4406-9b3f-98a4bd206d41 req-d576d189-e735-4e72-bae4-c720c49bc068 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:20:59.374620 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-fb33fe1f-ae0c-4406-9b3f-98a4bd206d41 req-d576d189-e735-4e72-bae4-c720c49bc068 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:20:59.404165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-fb33fe1f-ae0c-4406-9b3f-98a4bd206d41 req-d576d189-e735-4e72-bae4-c720c49bc068 service nova] Creating event network-vif-deleted:261aaf26-5f19-41e1-b97b-d37a713a7225 for instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 on hv-cinder-83976 Sep 11 15:20:59.407549 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9093af5f-919e-4746-9d0f-88cbe16e6f6a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:20:59.417519 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9093af5f-919e-4746-9d0f-88cbe16e6f6a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1214 microversion: 2.1 time: 0.189959 Sep 11 15:20:59.418271 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 386/771] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:20:59 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:20:59.431906 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-fb33fe1f-ae0c-4406-9b3f-98a4bd206d41 req-d576d189-e735-4e72-bae4-c720c49bc068 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107400 Sep 11 15:20:59.434653 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 386/772] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:00.192922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:00.197712 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:00.206335 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:00.207348 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:00.207794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:00.208517 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:00.209052 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:00.209687 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:00.272925 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:00.273828 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:00.274629 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:00.275551 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lazy-loading 'fault' on Instance uuid 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:21:00.353540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:00.368027 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ef8491a3-7f14-44a7-b719-a00d5a9f6f8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 200 len: 1327 microversion: 2.1 time: 0.179037 Sep 11 15:21:00.369601 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 387/773] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:00 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 1327 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:00.444276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:00.446050 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:00.453820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:00.454732 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:00.455414 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:00.456405 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:00.456924 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:00.457635 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:00.534426 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:00.544882 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1584c2bc-896b-4199-8a13-a4e2b1e430e1 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1266 microversion: 2.1 time: 0.106609 Sep 11 15:21:00.545517 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 387/774] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:00 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:01.406446 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:01.407756 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:01.417774 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:01.418686 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:01.419587 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:01.420876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:01.421810 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:01.422616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:01.448230 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] HTTP exception thrown: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Request method failure captured: Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 HTTP/1.1 Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfwpNi2WWVtsULJ98obXsl8c1LcYEocBDYoERnBTMNghZNxmbC1rqc-mCe1_zlIdIjPiOZfCAQHW3LUi0-VeZ2LMz66b2CQMwMH362H8EvaI0EYxkNtOJ9nRDFaem7TTYUs1TXiabp36ra3Z1gpCRH33hCKGxgskdDyHh5SOjSusC2c Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:21:01.451556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf1611f722d34ce0b058da277806b326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf1611f722d34ce0b058da277806b326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 948640729c5c4975b3b050129eb63eea Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:21:01.453229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '53bf29bf-c1c3-4a06-83c2-e3eb3df12430'} Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:21:01.454187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:21:01.455848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:21:01.457239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Returning 404 to user: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:21:01.457239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3554440c-e44e-4974-8661-cc970718aed5 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 404 len: 111 microversion: 2.1 time: 0.054742 Sep 11 15:21:01.457239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 388/775] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:01 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:21:01.465174 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3833a187-49fc-42b1-8571-199a464792ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '.version_select at 0x7f3933f13c10>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:01.489335 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3833a187-49fc-42b1-8571-199a464792ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008187726" status: 202 len: 0 microversion: 2.1 time: 0.028821 Sep 11 15:21:01.490404 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 388/776] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 15:21:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008187726 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:21:01.569045 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:01.570192 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:01.577238 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:01.577900 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:01.578663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:01.579329 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:01.579955 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:01.580360 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:01.786577 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:01.802409 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a479d880-0f98-47b3-bd66-0249e356ea1c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1314 microversion: 2.1 time: 0.237455 Sep 11 15:21:01.803019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 389/777] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:01 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:02.698288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6d954aaa-937c-493b-9114-d0b663bd7148 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'create', calling method: .version_select at 0x7f3933f5dee0>, body: {"keypair": {"name": "tempest-keypair-1152856669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxTSIOD588Z1QueS/yE1PRPYfgQUsULvpu8GcE9I+ouqO6cHUhJpry9yRl8sN2GKI6RdfwHVAL+Tjt8fbc1HxIrxw7fC1XIIoUQyTx7Xw9Ou2QaRFG0BBu76M/s9DzAmA=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:02.734254 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-6d954aaa-937c-493b-9114-d0b663bd7148 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Getting quotas for project bf1611f722d34ce0b058da277806b326. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:21:02.740368 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-6d954aaa-937c-493b-9114-d0b663bd7148 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Getting quotas for user 948640729c5c4975b3b050129eb63eea and project bf1611f722d34ce0b058da277806b326. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:21:02.773633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6d954aaa-937c-493b-9114-d0b663bd7148 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082986 Sep 11 15:21:02.774245 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 389/778] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:21:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:02.836882 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:02.839325 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:02.847898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:02.848885 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:02.849338 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:02.850361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:02.850867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:02.851303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:03.050882 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:03.064322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8e09c81e-2218-489f-908d-8c8ca17ff692 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1314 microversion: 2.1 time: 0.234914 Sep 11 15:21:03.065356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 390/779] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:02 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:03.220135 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-bd5fefea-e633-4ee2-9249-1d82ffed480b req-3049f474-ddbb-4e57-acca-a2a7b3a0c34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be83400-b5b6-4125-8008-a8568406cc34", "tag": "d525f16c-8919-4577-a9bb-6c882ebecb3b"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:03.231710 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bd5fefea-e633-4ee2-9249-1d82ffed480b req-3049f474-ddbb-4e57-acca-a2a7b3a0c34b service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:03.232515 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bd5fefea-e633-4ee2-9249-1d82ffed480b req-3049f474-ddbb-4e57-acca-a2a7b3a0c34b service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:03.232953 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bd5fefea-e633-4ee2-9249-1d82ffed480b req-3049f474-ddbb-4e57-acca-a2a7b3a0c34b service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:03.246809 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-bd5fefea-e633-4ee2-9249-1d82ffed480b req-3049f474-ddbb-4e57-acca-a2a7b3a0c34b service nova] Creating event network-changed:d525f16c-8919-4577-a9bb-6c882ebecb3b for instance 9be83400-b5b6-4125-8008-a8568406cc34 on hv-cinder-83976 Sep 11 15:21:03.253712 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-bd5fefea-e633-4ee2-9249-1d82ffed480b req-3049f474-ddbb-4e57-acca-a2a7b3a0c34b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038877 Sep 11 15:21:03.254558 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 390/780] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:04.093720 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:04.094562 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:04.102234 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:04.102804 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:04.103313 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:04.104176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:04.104739 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:04.105403 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:04.419307 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:04.430415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a1b1b521-1e63-4713-83c9-5005595d93db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1314 microversion: 2.1 time: 0.341468 Sep 11 15:21:04.431386 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 391/781] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:04 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:04.936990 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-436397221", "imageRef": "790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f33c684-59b7-47cf-8a30-9971261fe11c"}], "security_groups": [{"name": "tempest-securitygroup--1431815230"}], "key_name": "tempest-keypair-1152856669", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:05.108522 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] validate_networks() for [('9f33c684-59b7-47cf-8a30-9971261fe11c', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:21:05.463252 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:05.464333 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:05.475233 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:05.476055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:05.476685 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:05.477804 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:05.478470 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:05.479114 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:05.656274 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:21:05.657363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:21:05.658256 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:21:05.658997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:21:05.659744 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:21:05.675980 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:05.676856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:05.677659 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:05.679005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:05.679832 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:05.680601 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:05.692340 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:05.700687 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-626b6e85-edfb-4712-b5c6-4599a5515bec tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1314 microversion: 2.1 time: 0.249542 Sep 11 15:21:05.701409 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 392/782] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:05 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:21:05.708469 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Getting quotas for project bf1611f722d34ce0b058da277806b326. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:21:05.712812 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Getting quotas for user 948640729c5c4975b3b050129eb63eea and project bf1611f722d34ce0b058da277806b326. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:21:05.725455 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:21:05.728226 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='790f3851-6c6b-4ee8-8ae8-b7c6b9ef990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:21:05.783023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-deb34780-f988-415d-ae7a-f1c8e7cbb378 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.854345 Sep 11 15:21:05.783692 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 391/783] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:21:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 15:21:05.800368 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1d8e6260-ad90-4922-91a2-cfe5c6a1ed99 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:05.801079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1d8e6260-ad90-4922-91a2-cfe5c6a1ed99 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:05.874116 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1d8e6260-ad90-4922-91a2-cfe5c6a1ed99 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:05.887783 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1d8e6260-ad90-4922-91a2-cfe5c6a1ed99 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1237 microversion: 2.1 time: 0.091057 Sep 11 15:21:05.887783 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 393/784] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:05 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:06.732842 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:06.733760 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:06.743710 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:06.744400 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:06.745007 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:06.746038 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:06.746673 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:06.747263 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:06.900956 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:06.915703 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-81bff3e7-f4bd-4417-9d69-98c5f8eeae2c tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1314 microversion: 2.1 time: 0.195160 Sep 11 15:21:06.916768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 392/785] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:06 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:06.925633 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:06.926533 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:06.933489 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:06.933971 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:06.934592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:06.935525 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:06.936340 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:06.936764 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:07.011362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:07.024473 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0868639a-eab6-46fa-b613-a445ca804c73 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1289 microversion: 2.1 time: 0.103379 Sep 11 15:21:07.029614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 394/786] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:06 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:07.957470 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:07.958513 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:07.968373 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:07.969179 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:07.969839 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:07.971246 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:07.972411 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:07.973482 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:08.073055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:08.074879 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:08.088040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:08.089210 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:08.090177 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:08.091875 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:08.093246 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:08.094273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:08.239658 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:08.274998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-24fcf7d8-f58c-4643-ae1c-0cfc26bd7579 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1314 microversion: 2.1 time: 0.322188 Sep 11 15:21:08.289181 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 393/787] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:07 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:08.372606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:08.384082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cf7a6151-4c76-41b2-9567-7529ad0b71fd tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1363 microversion: 2.1 time: 0.321593 Sep 11 15:21:08.385080 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 395/788] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:08 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:09.224369 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b8313d56-01ae-4ae8-b27b-6e775ad5e6ca req-af7608f1-6e85-4f35-8c71-60230e0bc974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db8bda76-9501-4092-b5e6-5a74f90f37fb", "tag": "de7faf91-a048-4294-b8ab-451de51c5d08"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:09.254661 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b8313d56-01ae-4ae8-b27b-6e775ad5e6ca req-af7608f1-6e85-4f35-8c71-60230e0bc974 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:09.255633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b8313d56-01ae-4ae8-b27b-6e775ad5e6ca req-af7608f1-6e85-4f35-8c71-60230e0bc974 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:09.256082 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b8313d56-01ae-4ae8-b27b-6e775ad5e6ca req-af7608f1-6e85-4f35-8c71-60230e0bc974 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:09.269768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b8313d56-01ae-4ae8-b27b-6e775ad5e6ca req-af7608f1-6e85-4f35-8c71-60230e0bc974 service nova] Creating event network-changed:de7faf91-a048-4294-b8ab-451de51c5d08 for instance db8bda76-9501-4092-b5e6-5a74f90f37fb on hv-cinder-83976 Sep 11 15:21:09.278739 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b8313d56-01ae-4ae8-b27b-6e775ad5e6ca req-af7608f1-6e85-4f35-8c71-60230e0bc974 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061906 Sep 11 15:21:09.282336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 394/789] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:09.301811 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:09.302723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:09.313856 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:09.314437 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:09.315191 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:09.316319 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:09.316830 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:09.317611 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:09.427720 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:09.428973 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:09.439123 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:09.440008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:09.440790 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:09.442148 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:09.442930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:09.443657 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:09.502456 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:09.512659 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8f61d08c-cef4-4e1b-a326-fc2307b33fac tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1314 microversion: 2.1 time: 0.215369 Sep 11 15:21:09.513289 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 396/790] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:09 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:09.619512 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:09.628774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-971815c7-ab1f-44de-a63d-f956df39f75e tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1363 microversion: 2.1 time: 0.210238 Sep 11 15:21:09.629410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 395/791] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:09 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:21:10.051703 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-a1863456-0360-48e6-9cee-bc973acd8d2c req-0ecb8e44-c518-4120-b0bc-bd9ca21e0792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be83400-b5b6-4125-8008-a8568406cc34", "name": "network-vif-plugged", "status": "completed", "tag": "d525f16c-8919-4577-a9bb-6c882ebecb3b"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:10.065384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a1863456-0360-48e6-9cee-bc973acd8d2c req-0ecb8e44-c518-4120-b0bc-bd9ca21e0792 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:10.066883 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a1863456-0360-48e6-9cee-bc973acd8d2c req-0ecb8e44-c518-4120-b0bc-bd9ca21e0792 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:10.067599 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a1863456-0360-48e6-9cee-bc973acd8d2c req-0ecb8e44-c518-4120-b0bc-bd9ca21e0792 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:10.086839 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-a1863456-0360-48e6-9cee-bc973acd8d2c req-0ecb8e44-c518-4120-b0bc-bd9ca21e0792 service nova] Creating event network-vif-plugged:d525f16c-8919-4577-a9bb-6c882ebecb3b for instance 9be83400-b5b6-4125-8008-a8568406cc34 on hv-cinder-83976 Sep 11 15:21:10.096326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-a1863456-0360-48e6-9cee-bc973acd8d2c req-0ecb8e44-c518-4120-b0bc-bd9ca21e0792 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047944 Sep 11 15:21:10.097649 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 397/792] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:21:10.541080 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:10.542552 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:10.555791 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:10.556487 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:10.557266 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:10.558499 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:10.559223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:10.559763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:10.667749 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:10.668610 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:10.675858 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:10.676506 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:10.677036 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:10.677863 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:10.678554 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:10.679074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:10.808843 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:10.820581 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dbf152ea-3eb5-43c6-b8a8-3aae9f9498db tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1314 microversion: 2.1 time: 0.288146 Sep 11 15:21:10.821997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 396/793] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:10 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:21:10.871975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:10.879747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-52455dea-5572-4e88-8b7f-4b71d59451e3 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1363 microversion: 2.1 time: 0.218585 Sep 11 15:21:10.880297 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 398/794] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:10 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:11.844377 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:11.844983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:11.851946 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:11.852434 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:11.852858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:11.853572 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:11.854015 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:11.854427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:11.903107 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:11.903984 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:11.910947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:11.911431 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:11.911847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:11.912556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:11.912998 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:11.913458 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:12.035495 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:12.043855 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f10e70a1-1688-49dc-9805-9efe2f8c8c60 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1314 microversion: 2.1 time: 0.203802 Sep 11 15:21:12.044425 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 397/795] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:11 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:12.097187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:12.105295 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4e65c665-4a94-4e6b-a8e3-4a49c8f2fcc2 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1363 microversion: 2.1 time: 0.206143 Sep 11 15:21:12.106178 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 399/796] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:11 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:13.068151 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:13.068777 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:13.075574 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:13.076061 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:13.076492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:13.077217 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:13.077675 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:13.078120 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:13.137178 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:13.137797 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:13.144606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:13.145070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:13.145525 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:13.146240 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:13.146677 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:13.147086 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:13.267775 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:13.276670 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-41bb79df-a12b-4ecb-b98a-6f579e06e9c6 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1463 microversion: 2.1 time: 0.212368 Sep 11 15:21:13.277539 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 398/797] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:13 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1463 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:13.323651 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:13.324720 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:13.325242 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:13.331269 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:13.331708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-68bb8233-0f57-48b6-9577-e9c98aec89db tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1363 microversion: 2.1 time: 0.199152 Sep 11 15:21:13.331833 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:13.332168 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:13.332283 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 400/798] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:13 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:21:13.332871 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:13.333357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:13.333777 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:13.366351 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:21:13.452560 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7011d908-9889-4ae6-8272-39d2e620ae6f tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 204 len: 0 microversion: 2.1 time: 0.131304 Sep 11 15:21:13.453180 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 399/799] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:21:13 2022] DELETE /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 15:21:13.462082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:13.462700 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:13.469310 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:13.469796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:13.470225 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:13.470938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:13.471382 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:13.471795 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:13.492507 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:13.613020 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:13.622194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ee905507-b58b-4e4b-830d-24c05070a68e tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1469 microversion: 2.1 time: 0.164091 Sep 11 15:21:13.622790 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 401/800] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:13 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:14.355665 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:14.356390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:14.363442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:14.363906 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:14.364357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:14.365033 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:14.365507 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:14.365916 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:14.514845 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:14.525010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0433f1ae-e016-4911-979a-0d53b893db8d tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1363 microversion: 2.1 time: 0.173474 Sep 11 15:21:14.526041 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 400/801] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:14 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:14.645975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:14.646560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:14.653489 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:14.653960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:14.654386 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:14.655066 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:14.655510 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:14.655921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:14.826884 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf283b28e864d15b316edcf281e96f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e34e58001410699b1cb3fd88057e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:14.837113 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7bf4c9fd-1228-406b-8132-f650176a1d50 tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 200 len: 1469 microversion: 2.1 time: 0.194642 Sep 11 15:21:14.838354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 402/802] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:14 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:15.251687 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-d3b132a3-688b-4d3c-b106-3e684e1139f8 req-b69ef068-8ef3-46a3-b870-a744440fc7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be83400-b5b6-4125-8008-a8568406cc34", "name": "network-vif-deleted", "tag": "d525f16c-8919-4577-a9bb-6c882ebecb3b"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:15.268132 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d3b132a3-688b-4d3c-b106-3e684e1139f8 req-b69ef068-8ef3-46a3-b870-a744440fc7a4 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:15.268608 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d3b132a3-688b-4d3c-b106-3e684e1139f8 req-b69ef068-8ef3-46a3-b870-a744440fc7a4 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:15.269025 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d3b132a3-688b-4d3c-b106-3e684e1139f8 req-b69ef068-8ef3-46a3-b870-a744440fc7a4 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:15.283078 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-d3b132a3-688b-4d3c-b106-3e684e1139f8 req-b69ef068-8ef3-46a3-b870-a744440fc7a4 service nova] Creating event network-vif-deleted:d525f16c-8919-4577-a9bb-6c882ebecb3b for instance 9be83400-b5b6-4125-8008-a8568406cc34 on hv-cinder-83976 Sep 11 15:21:15.289241 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-d3b132a3-688b-4d3c-b106-3e684e1139f8 req-b69ef068-8ef3-46a3-b870-a744440fc7a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041285 Sep 11 15:21:15.289848 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 401/803] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:15.552405 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:15.553010 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:15.559795 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:15.560268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:15.561067 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:15.561783 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:15.562226 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:15.562644 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:15.710311 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:15.718736 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-801c2fed-c6ce-4adb-b703-344acc0cd2dc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1363 microversion: 2.1 time: 0.170229 Sep 11 15:21:15.719334 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 403/804] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:15 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:15.861765 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:15.862403 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] [instance: 9be83400-b5b6-4125-8008-a8568406cc34] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:15.864802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:15.865504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=16 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:15.872824 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:15.873359 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:15.873794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:15.874494 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:15.874940 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:15.875361 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:15.896189 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] HTTP exception thrown: Instance 9be83400-b5b6-4125-8008-a8568406cc34 could not be found. Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Request method failure captured: Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 HTTP/1.1 Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfzXaVyfs1E_emR63vpmjESKA7njORKC1e0hDebs6UdbuWrjRNurBietR2srnBSFhIaMixSPPCEdltl_I4ub7y3GysIkrcrkWB-wtyqyHJC5zBVABBaahmTqk5GTW7g1-e6taK2BdVQ8hUKd2P37dIWp3iTTutjtszR2mOA26X1KInE Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: ae1e34e58001410699b1cb3fd88057e5 Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesNegativeTest-1188699652 Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:21:15.898138 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ae1e34e58001410699b1cb3fd88057e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ae1e34e58001410699b1cb3fd88057e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ae1e34e58001410699b1cb3fd88057e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ae1e34e58001410699b1cb3fd88057e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesNegativeTest-1188699652 Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: ae1e34e58001410699b1cb3fd88057e5 Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesNegativeTest-1188699652 Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesNegativeTest-1188699652-project Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: faf283b28e864d15b316edcf281e96f9 Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesNegativeTest-1188699652-project Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 9be83400-b5b6-4125-8008-a8568406cc34 could not be found. Sep 11 15:21:15.899728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '9be83400-b5b6-4125-8008-a8568406cc34'} Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be83400-b5b6-4125-8008-a8568406cc34 could not be found. Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:21:15.900717 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be83400-b5b6-4125-8008-a8568406cc34 could not be found. Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be83400-b5b6-4125-8008-a8568406cc34 could not be found. Sep 11 15:21:15.902649 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:21:15.904211 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] Returning 404 to user: Instance 9be83400-b5b6-4125-8008-a8568406cc34 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:21:15.904211 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1bb5689e-6006-42ec-a7a3-f8068daddd9a tempest-VolumesNegativeTest-1188699652 tempest-VolumesNegativeTest-1188699652-project] 10.222.0.44 "GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34" status: 404 len: 111 microversion: 2.1 time: 0.042958 Sep 11 15:21:15.904211 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 402/805] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:15 2022] GET /compute/v2.1/servers/9be83400-b5b6-4125-8008-a8568406cc34 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:21:16.048328 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-654f5b1d-ec7c-4bc6-9b81-1055cd3f3f7c req-b5996c5a-b7f4-44af-bdef-944a112d464e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8bda76-9501-4092-b5e6-5a74f90f37fb", "name": "network-vif-plugged", "status": "completed", "tag": "de7faf91-a048-4294-b8ab-451de51c5d08"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:16.054513 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:16.061597 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-654f5b1d-ec7c-4bc6-9b81-1055cd3f3f7c req-b5996c5a-b7f4-44af-bdef-944a112d464e service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:16.062074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-654f5b1d-ec7c-4bc6-9b81-1055cd3f3f7c req-b5996c5a-b7f4-44af-bdef-944a112d464e service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:16.062793 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-654f5b1d-ec7c-4bc6-9b81-1055cd3f3f7c req-b5996c5a-b7f4-44af-bdef-944a112d464e service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:16.075744 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-654f5b1d-ec7c-4bc6-9b81-1055cd3f3f7c req-b5996c5a-b7f4-44af-bdef-944a112d464e service nova] Creating event network-vif-plugged:de7faf91-a048-4294-b8ab-451de51c5d08 for instance db8bda76-9501-4092-b5e6-5a74f90f37fb on hv-cinder-83976 Sep 11 15:21:16.081606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-654f5b1d-ec7c-4bc6-9b81-1055cd3f3f7c req-b5996c5a-b7f4-44af-bdef-944a112d464e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036970 Sep 11 15:21:16.082636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 404/806] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:16.743069 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:16.743794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:16.750484 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:16.750972 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:16.751399 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:16.752403 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:16.752854 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:16.753304 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:16.900468 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:16.904039 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:16.909293 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-43cd9204-4257-405f-994a-6b8b908d6b38 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1363 microversion: 2.1 time: 0.170582 Sep 11 15:21:16.909850 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 403/807] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:16 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:17.932388 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:17.933254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:17.944983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:17.945498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:17.946005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:17.946877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:17.947419 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:17.948419 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:18.116714 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:18.127123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3305233e-d0c9-404d-ba27-3eb5537736e8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1549 microversion: 2.1 time: 0.198865 Sep 11 15:21:18.127893 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 405/808] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:17 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:18.149988 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f44408d-d49e-4626-81f1-7227fae9351b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:18.150520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3f44408d-d49e-4626-81f1-7227fae9351b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:18.159896 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f44408d-d49e-4626-81f1-7227fae9351b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:18.160565 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f44408d-d49e-4626-81f1-7227fae9351b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:18.161002 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f44408d-d49e-4626-81f1-7227fae9351b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:18.161790 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f44408d-d49e-4626-81f1-7227fae9351b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:18.162283 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f44408d-d49e-4626-81f1-7227fae9351b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:18.162903 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f44408d-d49e-4626-81f1-7227fae9351b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:18.245097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3f44408d-d49e-4626-81f1-7227fae9351b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098907 Sep 11 15:21:18.245953 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 404/809] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 15:21:18 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:19.562926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-dc136c28-a8f6-4ef3-b432-5e8a09d6b385 req-59dea2b0-eba1-4562-ac2b-b272dfedff7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db8bda76-9501-4092-b5e6-5a74f90f37fb", "tag": "de7faf91-a048-4294-b8ab-451de51c5d08"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:19.573241 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-dc136c28-a8f6-4ef3-b432-5e8a09d6b385 req-59dea2b0-eba1-4562-ac2b-b272dfedff7f service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:19.573776 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-dc136c28-a8f6-4ef3-b432-5e8a09d6b385 req-59dea2b0-eba1-4562-ac2b-b272dfedff7f service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:19.574205 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-dc136c28-a8f6-4ef3-b432-5e8a09d6b385 req-59dea2b0-eba1-4562-ac2b-b272dfedff7f service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:19.585723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-dc136c28-a8f6-4ef3-b432-5e8a09d6b385 req-59dea2b0-eba1-4562-ac2b-b272dfedff7f service nova] Creating event network-changed:de7faf91-a048-4294-b8ab-451de51c5d08 for instance db8bda76-9501-4092-b5e6-5a74f90f37fb on hv-cinder-83976 Sep 11 15:21:19.590954 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-dc136c28-a8f6-4ef3-b432-5e8a09d6b385 req-59dea2b0-eba1-4562-ac2b-b272dfedff7f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032160 Sep 11 15:21:19.591565 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 406/810] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:31.161598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:31.162442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:31.555186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-402a144a-2b6a-4a2e-a846-7a1cca28ba21 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Action: 'create', calling method: .version_select at 0x7f3933e03310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1988693610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS7CORbVGRlEyVDq9aS1/7DFnjVrWda0eidNEgpFm9GQtmfaYu2Br8hIOm0mhN5ZScOlHQ5XLc8cPFDgm2RCqbhj0tf9UDjcSzKk0ZUzIx2eW43QY2vfZfhkBEAL9HXqg=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:31.580643 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-402a144a-2b6a-4a2e-a846-7a1cca28ba21 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Getting quotas for project ae3105c3aa57472899713ef172a862e4. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:21:31.585437 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-402a144a-2b6a-4a2e-a846-7a1cca28ba21 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Getting quotas for user 6e253dad57f44ab2955c353792fd5097 and project ae3105c3aa57472899713ef172a862e4. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:21:31.611494 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-402a144a-2b6a-4a2e-a846-7a1cca28ba21 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.451567 Sep 11 15:21:31.612405 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 405/811] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:21:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:46.960025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=56 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:46.960773 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=24 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:46.962076 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 15:21:46.962264 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Sun Sep 11 15:21:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.44) !!! Sep 11 15:21:46.968089 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-699865067", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1988693610", "security_groups": [{"name": "tempest-secgroup-smoke-1407267043"}], "networks": [{"uuid": "3aa90d16-9a09-409e-9099-34b81175badc"}], "block_device_mapping_v2": [{"uuid": "7bf47c31-869a-475d-b68f-67ae2cc3d0fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:47.095677 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] validate_networks() for [('3aa90d16-9a09-409e-9099-34b81175badc', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:21:47.483114 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:21:47.483529 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:21:47.484118 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:21:47.484532 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:21:47.484942 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:21:47.494447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:47.494927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:47.495356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:47.496078 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:47.496545 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:47.496960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:47.514250 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Getting quotas for project ae3105c3aa57472899713ef172a862e4. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:21:47.518441 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Getting quotas for user 6e253dad57f44ab2955c353792fd5097 and project ae3105c3aa57472899713ef172a862e4. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:21:47.576432 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:21:47.578722 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bf47c31-869a-475d-b68f-67ae2cc3d0fd',volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:21:47.720899 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-81ddb5f1-a89d-41f9-aa72-fad5695ab8b5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762449 Sep 11 15:21:47.721597 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 407/812] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:21:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:21:47.733795 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-430fcf0f-6f93-438e-b297-af00d8d1ae24 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:47.741191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-430fcf0f-6f93-438e-b297-af00d8d1ae24 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:47.746492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:47.747693 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:47.803724 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-430fcf0f-6f93-438e-b297-af00d8d1ae24 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:47.811789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-430fcf0f-6f93-438e-b297-af00d8d1ae24 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1088 microversion: 2.1 time: 0.082146 Sep 11 15:21:47.812364 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 406/813] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:47 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1088 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:48.834634 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:48.835410 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:48.842740 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:48.843614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:48.844120 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:48.845020 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:48.845737 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:48.846297 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:48.912640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:48.920350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2e232764-1ae8-4515-a882-cdbc5bbbf524 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1194 microversion: 2.1 time: 0.090164 Sep 11 15:21:48.920929 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 408/814] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:48 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:49.944427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:49.945008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:49.953167 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:49.953661 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:49.954090 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:49.954925 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:49.955227 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:49.955634 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:50.095348 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:50.103393 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8a50d533-81a2-4299-b16a-bab667711640 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.163303 Sep 11 15:21:50.104013 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 407/815] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:49 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:50.274564 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-15ac8592-f7ca-47be-a651-6fdd85a0bc5b req-b390f1e0-c2eb-4177-9275-4dde1a097ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d9d4f0-6987-4178-b7ec-3cb415f0ade0", "tag": "d63ce17e-b6af-4eea-a89b-48e0ac5ee02e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:50.287085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-15ac8592-f7ca-47be-a651-6fdd85a0bc5b req-b390f1e0-c2eb-4177-9275-4dde1a097ba1 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:50.287598 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-15ac8592-f7ca-47be-a651-6fdd85a0bc5b req-b390f1e0-c2eb-4177-9275-4dde1a097ba1 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:50.288333 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-15ac8592-f7ca-47be-a651-6fdd85a0bc5b req-b390f1e0-c2eb-4177-9275-4dde1a097ba1 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:50.301723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-15ac8592-f7ca-47be-a651-6fdd85a0bc5b req-b390f1e0-c2eb-4177-9275-4dde1a097ba1 service nova] Creating event network-changed:d63ce17e-b6af-4eea-a89b-48e0ac5ee02e for instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 on hv-cinder-83976 Sep 11 15:21:50.306964 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-15ac8592-f7ca-47be-a651-6fdd85a0bc5b req-b390f1e0-c2eb-4177-9275-4dde1a097ba1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036826 Sep 11 15:21:50.307775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 409/816] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:51.130984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:51.131591 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:51.138979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:51.139418 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:51.139851 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:51.140561 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:51.140993 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:51.141463 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:51.291103 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:51.299041 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-246d7c72-7819-45ee-b390-ef8a5988eb6c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.172194 Sep 11 15:21:51.299690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 408/817] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:51 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:52.324986 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:52.326044 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:52.335395 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:52.336089 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:52.336730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:52.337441 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:52.337892 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:52.338284 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:52.487544 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:52.498426 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eec78480-b2e3-49d2-aca3-5ad66dc2acbc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.179962 Sep 11 15:21:52.499225 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 410/818] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:52 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:53.522949 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:53.523574 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:53.530691 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:53.531099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:53.531531 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:53.532229 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:53.532738 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:53.533423 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:53.681663 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:53.690943 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a3cafaab-110f-488c-b78b-b94dfa34b7a5 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.171677 Sep 11 15:21:53.691543 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 409/819] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:53 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:54.715273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:54.715976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:54.723941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:54.724537 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:54.725081 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:54.725985 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:54.726532 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:54.727045 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:54.863399 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:54.876576 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ecefac61-1910-4aa3-8161-69326dbecef2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.165880 Sep 11 15:21:54.877396 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 411/820] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:54 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:55.471789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-064e3619-cf47-4454-9961-53bda5955e64 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:55.472363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-064e3619-cf47-4454-9961-53bda5955e64 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:55.481005 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-064e3619-cf47-4454-9961-53bda5955e64 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:55.481518 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-064e3619-cf47-4454-9961-53bda5955e64 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:55.481947 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-064e3619-cf47-4454-9961-53bda5955e64 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:55.483030 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-064e3619-cf47-4454-9961-53bda5955e64 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:55.483887 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-064e3619-cf47-4454-9961-53bda5955e64 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:55.484307 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-064e3619-cf47-4454-9961-53bda5955e64 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:55.509312 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-064e3619-cf47-4454-9961-53bda5955e64 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/ips" status: 200 len: 146 microversion: 2.1 time: 0.042536 Sep 11 15:21:55.509868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 410/821] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 15:21:55 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:55.900262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:55.900859 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:55.907340 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:55.907815 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:55.908232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:55.908909 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:55.909390 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:55.909791 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:56.052214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:56.060668 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4c8dbc26-bc59-4648-a75f-caf494cae1b2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.164477 Sep 11 15:21:56.061267 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 412/822] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:55 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:56.883218 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4ecf453d-6505-4e9f-83ad-c2737962a280 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aa694f2-c2a9-4541-be8c-ac7c582a67de"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:21:56.886879 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4ecf453d-6505-4e9f-83ad-c2737962a280 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:56.895584 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ecf453d-6505-4e9f-83ad-c2737962a280 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:56.896036 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ecf453d-6505-4e9f-83ad-c2737962a280 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:56.896487 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ecf453d-6505-4e9f-83ad-c2737962a280 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:56.897166 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ecf453d-6505-4e9f-83ad-c2737962a280 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:56.897650 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ecf453d-6505-4e9f-83ad-c2737962a280 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:56.898064 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4ecf453d-6505-4e9f-83ad-c2737962a280 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:57.092242 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:57.092953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:57.100328 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:57.100857 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:57.101308 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:57.102005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:57.102758 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:57.103329 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:57.177405 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4ecf453d-6505-4e9f-83ad-c2737962a280 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300366 Sep 11 15:21:57.178564 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 411/823] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:21:56 2022] POST /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:21:57.283624 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:57.292210 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6df8eae7-800d-430d-b9d6-3003dcecfe5f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.204121 Sep 11 15:21:57.292848 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 413/824] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:57 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:58.316466 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:58.317296 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:58.319845 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:58.325722 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:58.326131 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:58.326571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:58.327260 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:58.327704 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:58.328102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:58.471696 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:58.479709 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-06bd0f86-5595-407f-8c0c-38bec6a6b26f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.167550 Sep 11 15:21:58.480268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 412/825] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:58 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:21:59.504388 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:21:59.504938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:21:59.507176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:59.507924 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:21:59.514595 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:59.515095 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:59.515527 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:59.516214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:21:59.516661 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:21:59.517074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:21:59.658373 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:21:59.666966 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-816d7fce-d15d-4220-b047-02dcaaba0b8e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.166942 Sep 11 15:21:59.667543 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 414/826] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:21:59 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:22:00.690926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:00.691502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:00.698501 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:00.698983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:00.699422 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:00.700186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:00.700633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:00.701059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:00.836665 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:22:00.847042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-aca8d520-506b-46ae-a49c-2ca09132996b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.160071 Sep 11 15:22:00.847746 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 413/827] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:00 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:22:01.869927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:01.870639 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:01.877609 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:01.878083 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:01.878506 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:01.879187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:01.879629 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:01.880050 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:02.029530 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:22:02.037542 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0be430e6-dbd9-4bc5-b38f-b7caca6f7917 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.171505 Sep 11 15:22:02.038106 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 415/828] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:01 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:22:02.279111 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-296157ef-a7fd-4939-b0c7-1480c9fe5fd6 req-1b346483-e537-4a19-8ab4-859256352d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d9d4f0-6987-4178-b7ec-3cb415f0ade0", "name": "network-vif-plugged", "status": "completed", "tag": "d63ce17e-b6af-4eea-a89b-48e0ac5ee02e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:22:02.289473 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-296157ef-a7fd-4939-b0c7-1480c9fe5fd6 req-1b346483-e537-4a19-8ab4-859256352d42 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:02.290022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-296157ef-a7fd-4939-b0c7-1480c9fe5fd6 req-1b346483-e537-4a19-8ab4-859256352d42 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:02.290526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-296157ef-a7fd-4939-b0c7-1480c9fe5fd6 req-1b346483-e537-4a19-8ab4-859256352d42 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:02.303782 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-296157ef-a7fd-4939-b0c7-1480c9fe5fd6 req-1b346483-e537-4a19-8ab4-859256352d42 service nova] Creating event network-vif-plugged:d63ce17e-b6af-4eea-a89b-48e0ac5ee02e for instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 on hv-cinder-83976 Sep 11 15:22:02.310985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-296157ef-a7fd-4939-b0c7-1480c9fe5fd6 req-1b346483-e537-4a19-8ab4-859256352d42 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034726 Sep 11 15:22:02.311669 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 414/829] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:22:03.060610 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:03.061235 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:03.068147 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:03.068636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:03.069060 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:03.069796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:03.070238 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:03.070663 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:03.208794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:22:03.220790 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fbd84690-c839-45f2-9b67-befd0b313a6f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1260 microversion: 2.1 time: 0.164191 Sep 11 15:22:03.221611 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 416/830] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:03 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:22:04.246441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:04.247151 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:04.253919 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:04.254403 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:04.254843 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:04.255543 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:04.255996 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:04.256408 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:04.392585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:22:04.404828 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0ccad08f-7b7e-473c-998d-4fd4fbc46245 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1443 microversion: 2.1 time: 0.163014 Sep 11 15:22:04.405679 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 415/831] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:04 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:22:04.427215 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:04.427819 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:04.435362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:04.435833 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:04.436258 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:04.436939 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:04.437414 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:04.437825 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:04.577791 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:22:04.585675 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2836ad0d-33bb-4ca3-bce4-373f88371c3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1443 microversion: 2.1 time: 0.162374 Sep 11 15:22:04.586243 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 417/832] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:04 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:22:04.765923 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-232b1198-8815-4c18-ad2d-45ed7c9f369a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:04.768091 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-232b1198-8815-4c18-ad2d-45ed7c9f369a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:04.774174 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-232b1198-8815-4c18-ad2d-45ed7c9f369a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:04.774662 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-232b1198-8815-4c18-ad2d-45ed7c9f369a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:04.775092 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-232b1198-8815-4c18-ad2d-45ed7c9f369a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:04.775783 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-232b1198-8815-4c18-ad2d-45ed7c9f369a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:04.776234 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-232b1198-8815-4c18-ad2d-45ed7c9f369a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:04.776646 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-232b1198-8815-4c18-ad2d-45ed7c9f369a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:04.810580 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-232b1198-8815-4c18-ad2d-45ed7c9f369a tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048549 Sep 11 15:22:04.811428 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 416/833] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:22:04 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:22:04.822394 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0f221c3d-6de6-42ae-aeba-4fa378b7b3ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:04.822965 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0f221c3d-6de6-42ae-aeba-4fa378b7b3ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:04.829496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0f221c3d-6de6-42ae-aeba-4fa378b7b3ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:04.830061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0f221c3d-6de6-42ae-aeba-4fa378b7b3ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:04.830581 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0f221c3d-6de6-42ae-aeba-4fa378b7b3ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:04.831392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0f221c3d-6de6-42ae-aeba-4fa378b7b3ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:04.831887 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0f221c3d-6de6-42ae-aeba-4fa378b7b3ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:04.832301 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0f221c3d-6de6-42ae-aeba-4fa378b7b3ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:04.863909 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0f221c3d-6de6-42ae-aeba-4fa378b7b3ac tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/1aa694f2-c2a9-4541-be8c-ac7c582a67de" status: 200 len: 194 microversion: 2.1 time: 0.045490 Sep 11 15:22:04.864431 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 418/834] 10.222.0.44 () {58 vars in 1413 bytes} [Sun Sep 11 15:22:04 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/1aa694f2-c2a9-4541-be8c-ac7c582a67de => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:22:06.240647 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cd953ea2-59fe-4794-b11b-bd39a7997a10 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab985d2a-90c9-46f1-811d-1393da8ba285"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:22:06.243026 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cd953ea2-59fe-4794-b11b-bd39a7997a10 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:06.249972 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd953ea2-59fe-4794-b11b-bd39a7997a10 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:06.250460 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd953ea2-59fe-4794-b11b-bd39a7997a10 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:06.250893 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd953ea2-59fe-4794-b11b-bd39a7997a10 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:06.251587 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd953ea2-59fe-4794-b11b-bd39a7997a10 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:06.252031 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd953ea2-59fe-4794-b11b-bd39a7997a10 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:06.252442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd953ea2-59fe-4794-b11b-bd39a7997a10 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:06.521281 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cd953ea2-59fe-4794-b11b-bd39a7997a10 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "POST /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284434 Sep 11 15:22:06.521907 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 417/835] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:22:06 2022] POST /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:22:06.693766 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-e9bd368a-3983-4e3b-b7bc-2f2d092f36c3 req-9144211c-ac24-4e3c-be4f-10bc34073349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d9d4f0-6987-4178-b7ec-3cb415f0ade0", "tag": "d63ce17e-b6af-4eea-a89b-48e0ac5ee02e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:22:06.705213 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e9bd368a-3983-4e3b-b7bc-2f2d092f36c3 req-9144211c-ac24-4e3c-be4f-10bc34073349 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:06.706079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e9bd368a-3983-4e3b-b7bc-2f2d092f36c3 req-9144211c-ac24-4e3c-be4f-10bc34073349 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:06.706547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e9bd368a-3983-4e3b-b7bc-2f2d092f36c3 req-9144211c-ac24-4e3c-be4f-10bc34073349 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:06.718268 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-e9bd368a-3983-4e3b-b7bc-2f2d092f36c3 req-9144211c-ac24-4e3c-be4f-10bc34073349 service nova] Creating event network-changed:d63ce17e-b6af-4eea-a89b-48e0ac5ee02e for instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 on hv-cinder-83976 Sep 11 15:22:06.723517 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-e9bd368a-3983-4e3b-b7bc-2f2d092f36c3 req-9144211c-ac24-4e3c-be4f-10bc34073349 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035863 Sep 11 15:22:06.724128 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 419/836] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:22:14.113966 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-61b53ced-8a9e-4dd7-85da-81d880ebd143 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:14.116340 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-61b53ced-8a9e-4dd7-85da-81d880ebd143 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:14.123324 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b53ced-8a9e-4dd7-85da-81d880ebd143 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:14.123795 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b53ced-8a9e-4dd7-85da-81d880ebd143 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:14.124228 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b53ced-8a9e-4dd7-85da-81d880ebd143 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:14.124944 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b53ced-8a9e-4dd7-85da-81d880ebd143 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:14.125418 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b53ced-8a9e-4dd7-85da-81d880ebd143 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:14.125836 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b53ced-8a9e-4dd7-85da-81d880ebd143 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:14.157723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-61b53ced-8a9e-4dd7-85da-81d880ebd143 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048835 Sep 11 15:22:14.158296 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 418/837] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:22:14 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:22:14.307384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-110c3bf2-1401-43c5-a98b-76d5b33e1ea4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:14.307951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-110c3bf2-1401-43c5-a98b-76d5b33e1ea4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:14.315413 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-110c3bf2-1401-43c5-a98b-76d5b33e1ea4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:14.315898 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-110c3bf2-1401-43c5-a98b-76d5b33e1ea4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:14.316323 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-110c3bf2-1401-43c5-a98b-76d5b33e1ea4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:14.317016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-110c3bf2-1401-43c5-a98b-76d5b33e1ea4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:14.317503 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-110c3bf2-1401-43c5-a98b-76d5b33e1ea4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:14.317915 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-110c3bf2-1401-43c5-a98b-76d5b33e1ea4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:14.347887 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-110c3bf2-1401-43c5-a98b-76d5b33e1ea4 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/1aa694f2-c2a9-4541-be8c-ac7c582a67de" status: 200 len: 194 microversion: 2.1 time: 0.045618 Sep 11 15:22:14.348472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 420/838] 10.222.0.44 () {58 vars in 1413 bytes} [Sun Sep 11 15:22:14 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/1aa694f2-c2a9-4541-be8c-ac7c582a67de => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:22:14.362308 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:14.362794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:14.369720 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:14.370200 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:14.370631 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:14.371310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:14.371776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:14.372197 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:14.458877 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lazy-loading 'services' on Instance uuid db8bda76-9501-4092-b5e6-5a74f90f37fb {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:22:14.538186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-73bcc5f7-5657-473b-8044-fa7028e73f60 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "DELETE /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/1aa694f2-c2a9-4541-be8c-ac7c582a67de" status: 202 len: 0 microversion: 2.1 time: 0.179569 Sep 11 15:22:14.538856 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 419/839] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:22:14 2022] DELETE /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/1aa694f2-c2a9-4541-be8c-ac7c582a67de => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:22:15.691652 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9acbed51-1d0f-4af1-9204-3dc91c803871 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:15.692244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9acbed51-1d0f-4af1-9204-3dc91c803871 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:15.698779 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9acbed51-1d0f-4af1-9204-3dc91c803871 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:15.699256 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9acbed51-1d0f-4af1-9204-3dc91c803871 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:15.699684 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9acbed51-1d0f-4af1-9204-3dc91c803871 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:15.700425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9acbed51-1d0f-4af1-9204-3dc91c803871 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:15.700871 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9acbed51-1d0f-4af1-9204-3dc91c803871 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:15.701326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9acbed51-1d0f-4af1-9204-3dc91c803871 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:15.736661 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9acbed51-1d0f-4af1-9204-3dc91c803871 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/ab985d2a-90c9-46f1-811d-1393da8ba285" status: 200 len: 194 microversion: 2.1 time: 0.049080 Sep 11 15:22:15.737288 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 421/840] 10.222.0.44 () {58 vars in 1413 bytes} [Sun Sep 11 15:22:15 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/ab985d2a-90c9-46f1-811d-1393da8ba285 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:22:15.754152 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:15.754735 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:15.763835 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:15.764633 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:15.765052 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:15.765764 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:15.766208 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:15.766624 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:15.851426 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lazy-loading 'services' on Instance uuid db8bda76-9501-4092-b5e6-5a74f90f37fb {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:22:15.854905 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:22:15.927814 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bc76b512-2546-49fe-aeca-83567bc7ab5f tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "DELETE /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/ab985d2a-90c9-46f1-811d-1393da8ba285" status: 202 len: 0 microversion: 2.1 time: 0.180563 Sep 11 15:22:15.928668 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 420/841] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:22:15 2022] DELETE /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments/ab985d2a-90c9-46f1-811d-1393da8ba285 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:22:17.120089 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-99eaad28-e630-402d-966c-28be977b4d03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:17.122365 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-99eaad28-e630-402d-966c-28be977b4d03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:17.124895 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:22:17.130386 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99eaad28-e630-402d-966c-28be977b4d03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:17.130867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99eaad28-e630-402d-966c-28be977b4d03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:17.131597 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99eaad28-e630-402d-966c-28be977b4d03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:17.131976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99eaad28-e630-402d-966c-28be977b4d03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:17.132421 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99eaad28-e630-402d-966c-28be977b4d03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:17.132834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99eaad28-e630-402d-966c-28be977b4d03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:17.136060 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=79 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:22:17.165669 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-99eaad28-e630-402d-966c-28be977b4d03 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049736 Sep 11 15:22:17.166234 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 422/842] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:22:17 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 15:22:17.302437 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-15f68dac-8f00-4766-9547-203d791ff2d8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:17.304691 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-15f68dac-8f00-4766-9547-203d791ff2d8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:17.311684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f68dac-8f00-4766-9547-203d791ff2d8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:17.312163 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f68dac-8f00-4766-9547-203d791ff2d8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:17.312588 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f68dac-8f00-4766-9547-203d791ff2d8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:17.313524 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f68dac-8f00-4766-9547-203d791ff2d8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:17.313984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f68dac-8f00-4766-9547-203d791ff2d8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:17.314602 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15f68dac-8f00-4766-9547-203d791ff2d8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:17.352280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-15f68dac-8f00-4766-9547-203d791ff2d8 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055152 Sep 11 15:22:17.353117 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 421/843] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:22:17 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 15:22:17.419303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:17.419792 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:17.426677 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:17.427168 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:17.427581 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:17.428265 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:17.428713 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:17.429127 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:17.454740 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:22:17.539528 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f5cb0db7-e52a-4544-a276-0184554650cc tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "DELETE /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 204 len: 0 microversion: 2.1 time: 0.123612 Sep 11 15:22:17.540674 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 423/844] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:22:17 2022] DELETE /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:22:17.548926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:17.549554 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:17.555897 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:17.556374 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:17.556804 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:17.557517 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:17.557956 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:17.558374 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:17.711303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:22:17.720526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ab7af887-3903-4507-a864-61df237cb9c6 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1674 microversion: 2.1 time: 0.175426 Sep 11 15:22:17.721105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 422/845] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:17 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:22:18.744983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:18.745703 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:18.752730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:18.753243 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:18.753668 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:18.754358 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:18.754808 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:18.755221 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:19.147592 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:22:19.156039 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5a419ded-367d-4065-91c0-8f36da0ad935 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1674 microversion: 2.1 time: 0.415439 Sep 11 15:22:19.156680 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 424/846] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:18 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1674 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:22:20.183241 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:20.186009 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:20.190295 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=37 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:22:20.195538 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:20.196372 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:20.196542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:20.197259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:20.197636 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:20.198051 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:20.252383 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-940b1998-e664-4dd0-abe8-367639e2287e req-5f8492d7-89fd-42f6-a3c6-8fc6ed076d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8bda76-9501-4092-b5e6-5a74f90f37fb", "name": "network-vif-deleted", "tag": "de7faf91-a048-4294-b8ab-451de51c5d08"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:22:20.263847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-940b1998-e664-4dd0-abe8-367639e2287e req-5f8492d7-89fd-42f6-a3c6-8fc6ed076d2f service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:20.264369 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-940b1998-e664-4dd0-abe8-367639e2287e req-5f8492d7-89fd-42f6-a3c6-8fc6ed076d2f service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:20.264973 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-940b1998-e664-4dd0-abe8-367639e2287e req-5f8492d7-89fd-42f6-a3c6-8fc6ed076d2f service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:20.288366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-940b1998-e664-4dd0-abe8-367639e2287e req-5f8492d7-89fd-42f6-a3c6-8fc6ed076d2f service nova] Creating event network-vif-deleted:de7faf91-a048-4294-b8ab-451de51c5d08 for instance db8bda76-9501-4092-b5e6-5a74f90f37fb on hv-cinder-83976 Sep 11 15:22:20.294468 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-940b1998-e664-4dd0-abe8-367639e2287e req-5f8492d7-89fd-42f6-a3c6-8fc6ed076d2f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044897 Sep 11 15:22:20.297775 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948640729c5c4975b3b050129eb63eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1611f722d34ce0b058da277806b326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:22:20.298299 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 425/847] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:22:20.307113 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dd4c3d43-ec89-41fd-9750-ef8e3c34b0fe tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 200 len: 1606 microversion: 2.1 time: 0.130219 Sep 11 15:22:20.307974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 423/848] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:20 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 1606 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:22:21.336751 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:21.338234 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:21.344769 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:21.345274 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:21.345717 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:21.346440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:21.346919 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:21.347344 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:21.367370 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] HTTP exception thrown: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Request method failure captured: Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb HTTP/1.1 Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfwpNi2WWVtsULJ98obXsl8c1LcYEocBDYoERnBTMNghZNxmbC1rqc-mCe1_zlIdIjPiOZfCAQHW3LUi0-VeZ2LMz66b2CQMwMH362H8EvaI0EYxkNtOJ9nRDFaem7TTYUs1TXiabp36ra3Z1gpCRH33hCKGxgskdDyHh5SOjSusC2c Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:22:21.370248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf1611f722d34ce0b058da277806b326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf1611f722d34ce0b058da277806b326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 948640729c5c4975b3b050129eb63eea Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:21.371702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'db8bda76-9501-4092-b5e6-5a74f90f37fb'} Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:22:21.372486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:21.374339 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:21.376190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Returning 404 to user: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:22:21.376190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8c098b77-e109-4521-b418-9a894c36a9ad tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 404 len: 111 microversion: 2.1 time: 0.040367 Sep 11 15:22:21.376190 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 426/849] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:21 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:22:21.384016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-edfc3fb4-31f8-46ff-bf73-5cf48907d528 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '.version_select at 0x7f3933f13c10>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:21.408243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-edfc3fb4-31f8-46ff-bf73-5cf48907d528 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152856669" status: 202 len: 0 microversion: 2.1 time: 0.028463 Sep 11 15:22:21.408849 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 424/850] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 15:22:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152856669 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:22:24.416532 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:24.417192 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:24.424695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:24.425095 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:24.425576 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:24.426281 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:24.426738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:24.427151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:24.445342 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] HTTP exception thrown: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Request method failure captured: Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb HTTP/1.1 Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfwpNi2WWVtsULJ98obXsl8c1LcYEocBDYoERnBTMNghZNxmbC1rqc-mCe1_zlIdIjPiOZfCAQHW3LUi0-VeZ2LMz66b2CQMwMH362H8EvaI0EYxkNtOJ9nRDFaem7TTYUs1TXiabp36ra3Z1gpCRH33hCKGxgskdDyHh5SOjSusC2c Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:22:24.446937 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf1611f722d34ce0b058da277806b326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf1611f722d34ce0b058da277806b326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 948640729c5c4975b3b050129eb63eea Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.448976 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': 'db8bda76-9501-4092-b5e6-5a74f90f37fb'} Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:22:24.450229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.451706 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.453300 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Returning 404 to user: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:22:24.453300 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1aeff242-f832-4766-98d3-1470ee180278 tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "DELETE /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 404 len: 111 microversion: 2.1 time: 0.035995 Sep 11 15:22:24.453300 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 427/851] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:22:24 2022] DELETE /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:22:24.458254 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:24.458894 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: db8bda76-9501-4092-b5e6-5a74f90f37fb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:24.466463 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:24.466943 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:24.467383 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:24.468125 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:24.468583 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:24.469010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:24.484525 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] HTTP exception thrown: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Request method failure captured: Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb HTTP/1.1 Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfwpNi2WWVtsULJ98obXsl8c1LcYEocBDYoERnBTMNghZNxmbC1rqc-mCe1_zlIdIjPiOZfCAQHW3LUi0-VeZ2LMz66b2CQMwMH362H8EvaI0EYxkNtOJ9nRDFaem7TTYUs1TXiabp36ra3Z1gpCRH33hCKGxgskdDyHh5SOjSusC2c Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:22:24.486350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf1611f722d34ce0b058da277806b326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf1611f722d34ce0b058da277806b326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 948640729c5c4975b3b050129eb63eea Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.487858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': 'db8bda76-9501-4092-b5e6-5a74f90f37fb'} Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:22:24.488725 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. Sep 11 15:22:24.490027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:24.491161 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Returning 404 to user: Instance db8bda76-9501-4092-b5e6-5a74f90f37fb could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:22:24.491161 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-64f64d57-e07c-4047-8098-f557c9ada11b tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb" status: 404 len: 111 microversion: 2.1 time: 0.034388 Sep 11 15:22:24.491161 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 425/852] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:24 2022] GET /compute/v2.1/servers/db8bda76-9501-4092-b5e6-5a74f90f37fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:22:25.643876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:25.644520 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:25.651407 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:25.651886 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:25.652309 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:25.653000 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:25.653491 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:25.653903 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:25.669088 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] HTTP exception thrown: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Request method failure captured: Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 HTTP/1.1 Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHfwpNi2WWVtsULJ98obXsl8c1LcYEocBDYoERnBTMNghZNxmbC1rqc-mCe1_zlIdIjPiOZfCAQHW3LUi0-VeZ2LMz66b2CQMwMH362H8EvaI0EYxkNtOJ9nRDFaem7TTYUs1TXiabp36ra3Z1gpCRH33hCKGxgskdDyHh5SOjSusC2c Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:22:25.670842 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf1611f722d34ce0b058da277806b326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf1611f722d34ce0b058da277806b326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 948640729c5c4975b3b050129eb63eea Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.672375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '53bf29bf-c1c3-4a06-83c2-e3eb3df12430'} Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:22:25.673733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.675807 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.677637 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Returning 404 to user: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:22:25.677637 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4759e76d-d7e7-4920-abf8-21aaca828e7c tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "DELETE /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 404 len: 111 microversion: 2.1 time: 0.033553 Sep 11 15:22:25.677637 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 428/853] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:22:25 2022] DELETE /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:22:25.681276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:22:25.681933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] [instance: 53bf29bf-c1c3-4a06-83c2-e3eb3df12430] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:22:25.688461 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:25.688912 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:25.689360 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:25.690064 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:22:25.690506 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:22:25.690916 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:22:25.706464 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] HTTP exception thrown: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Request method failure captured: Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 HTTP/1.1 Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfwpNi2WWVtsULJ98obXsl8c1LcYEocBDYoERnBTMNghZNxmbC1rqc-mCe1_zlIdIjPiOZfCAQHW3LUi0-VeZ2LMz66b2CQMwMH362H8EvaI0EYxkNtOJ9nRDFaem7TTYUs1TXiabp36ra3Z1gpCRH33hCKGxgskdDyHh5SOjSusC2c Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:22:25.707997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf1611f722d34ce0b058da277806b326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf1611f722d34ce0b058da277806b326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf1611f722d34ce0b058da277806b326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: bf1611f722d34ce0b058da277806b326 Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817527677 Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 948640729c5c4975b3b050129eb63eea Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeTestJSON-1817527677-project Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.709776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '53bf29bf-c1c3-4a06-83c2-e3eb3df12430'} Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:22:25.711016 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. Sep 11 15:22:25.712503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:22:25.713999 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] Returning 404 to user: Instance 53bf29bf-c1c3-4a06-83c2-e3eb3df12430 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:22:25.713999 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-35f5b58f-dc68-4e4f-9742-82f85895f1df tempest-AttachVolumeTestJSON-1817527677 tempest-AttachVolumeTestJSON-1817527677-project] 10.222.0.44 "GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430" status: 404 len: 111 microversion: 2.1 time: 0.032039 Sep 11 15:22:25.713999 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 426/854] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:22:25 2022] GET /compute/v2.1/servers/53bf29bf-c1c3-4a06-83c2-e3eb3df12430 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 15:24:02.464086 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:02.464827 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:02.469656 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7809b4c0-dd62-465e-b690-a99c7458b1d6 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Action: 'create', calling method: .version_select at 0x7f3933e3baf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-409772676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN86k3eoBL0b9pMLDM70gNwpC8Op1WlRTKW5iuHGpYtLuNVKumDSYLnKdMAathFG8zEjHrM7q89O/Jr8nElUB+nGnp0P8uHsXQLpqK2QfbZRyyYgEVnR0UPsR1HbN0ySLw=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:02.488086 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-7809b4c0-dd62-465e-b690-a99c7458b1d6 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Getting quotas for project 5b8c0728fc2e4e54ab90bbce9be73862. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:24:02.492032 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-7809b4c0-dd62-465e-b690-a99c7458b1d6 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Getting quotas for user 53fd875fa50e4bee8bb7cece0efe4e9b and project 5b8c0728fc2e4e54ab90bbce9be73862. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:24:02.523453 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7809b4c0-dd62-465e-b690-a99c7458b1d6 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061188 Sep 11 15:24:02.524059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 429/855] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:24:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:24:02.572974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:02.573944 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:02.575193 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 15:24:02.575427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Sun Sep 11 15:24:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.44) !!! Sep 11 15:24:02.581355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-923769915", "imageRef": "7103f9c4-9ff5-429b-b670-61f4354511ba", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-409772676", "networks": [{"uuid": "3d278269-9c8f-4cea-8541-ed2ef1e7634e"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:02.772788 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] validate_networks() for [('3d278269-9c8f-4cea-8541-ed2ef1e7634e', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:24:03.151436 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:03.151979 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:03.158348 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:03.158828 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:03.159246 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:03.159927 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:03.160366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:03.160772 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:03.184437 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lazy-loading 'flavor' on Instance uuid 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:24:03.267378 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8cced63a-e5c3-479b-b1bc-763a9225ddfb tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "POST /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0/action" status: 202 len: 0 microversion: 2.1 time: 0.119704 Sep 11 15:24:03.268551 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 430/856] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:24:03 2022] POST /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:24:03.277219 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:03.277917 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:03.284366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:03.285123 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:03.285386 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:03.286077 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:03.286487 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:03.286914 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:03.304731 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:24:03.305293 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:24:03.305868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:24:03.306414 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:24:03.306927 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:24:03.317868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:03.318415 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:03.318970 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:03.319810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:03.320261 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:03.320681 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:03.339099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Getting quotas for project 5b8c0728fc2e4e54ab90bbce9be73862. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:24:03.343106 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Getting quotas for user 53fd875fa50e4bee8bb7cece0efe4e9b and project 5b8c0728fc2e4e54ab90bbce9be73862. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:24:03.354202 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:24:03.356453 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7103f9c4-9ff5-429b-b670-61f4354511ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:24:03.406457 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ae9f9fd3-f510-4078-8bc0-a5ff765937a4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835223 Sep 11 15:24:03.413000 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 427/857] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:24:03.420278 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f0cf0faa-6a71-478f-a0fd-d1421ee46588 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:03.420993 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f0cf0faa-6a71-478f-a0fd-d1421ee46588 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:03.490243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f0cf0faa-6a71-478f-a0fd-d1421ee46588 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:03.498603 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f0cf0faa-6a71-478f-a0fd-d1421ee46588 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1257 microversion: 2.1 time: 0.083976 Sep 11 15:24:03.499336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 428/858] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:03 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:03.507230 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:03.517859 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-31169ca8-d3fd-43e3-a764-377431142991 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.245224 Sep 11 15:24:03.518495 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 431/859] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:03 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:24:04.524332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-44c04e37-4231-475c-817e-aa7cdb4559a8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:04.525165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-44c04e37-4231-475c-817e-aa7cdb4559a8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:04.541666 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:04.542510 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:04.549253 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:04.549732 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:04.550151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:04.550836 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:04.551573 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:04.552187 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:04.583869 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-44c04e37-4231-475c-817e-aa7cdb4559a8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:04.591595 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-44c04e37-4231-475c-817e-aa7cdb4559a8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1257 microversion: 2.1 time: 0.072591 Sep 11 15:24:04.592511 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 429/860] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:04 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:04.686079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:04.693885 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b968b729-c71d-42ab-ac4a-b3768242317c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.156008 Sep 11 15:24:04.694418 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 432/861] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:04 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:05.618847 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5654a158-734e-4c31-b5a1-03ba1f6c9cf2 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:05.619791 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5654a158-734e-4c31-b5a1-03ba1f6c9cf2 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:05.688619 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5654a158-734e-4c31-b5a1-03ba1f6c9cf2 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:05.695684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5654a158-734e-4c31-b5a1-03ba1f6c9cf2 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1257 microversion: 2.1 time: 0.083636 Sep 11 15:24:05.696262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 430/862] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:05 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:05.717323 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:05.717925 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:05.724540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:05.725014 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:05.725461 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:05.726142 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:05.726586 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:05.726993 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:05.871164 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:05.879315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d525e8f8-2bd3-4f9f-b1b3-8ce812c212d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.166108 Sep 11 15:24:05.879887 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 433/863] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:05 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:06.718802 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b07a0b30-8f43-47e0-bb6c-907a064f311d tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:06.720083 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b07a0b30-8f43-47e0-bb6c-907a064f311d tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:06.773610 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b07a0b30-8f43-47e0-bb6c-907a064f311d tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:06.781060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b07a0b30-8f43-47e0-bb6c-907a064f311d tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1257 microversion: 2.1 time: 0.066658 Sep 11 15:24:06.781660 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 431/864] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:06 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:06.902827 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:06.903486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:06.910072 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:06.910569 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:06.911201 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:06.911863 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:06.912358 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:06.912774 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:07.045686 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:07.053520 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-629fc078-2b61-4b12-8cf0-35bd54d2a805 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.154828 Sep 11 15:24:07.054098 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 434/865] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:06 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:07.814842 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:07.815420 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:07.825485 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:07.826050 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:07.826919 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:07.827600 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:07.828045 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:07.828457 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:07.902126 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:07.910010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1b5ad83a-ec88-4acb-b372-5322bf168cf0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1261 microversion: 2.1 time: 0.100910 Sep 11 15:24:07.910578 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 432/866] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:07 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:08.078998 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:08.079774 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:08.086363 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:08.086847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:08.087272 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:08.087949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:08.088409 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:08.088818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:08.237800 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:08.246733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4d2ce476-1b52-4ba4-b7f8-258ab436b388 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.173403 Sep 11 15:24:08.247775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 435/867] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:08 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:08.933187 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:08.933796 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:08.942278 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:08.942759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:08.943190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:08.943890 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:08.944329 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:08.944742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:09.023036 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:09.031381 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-431f2fe0-b759-47e6-a3d4-09eaa047f341 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1315 microversion: 2.1 time: 0.102978 Sep 11 15:24:09.037437 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 433/868] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:08 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1315 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:09.277590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:09.278649 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:09.292587 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:09.294844 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:09.295394 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:09.296152 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:09.296613 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:09.297047 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:09.710070 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:09.722633 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-31817d63-63a8-4c81-94cb-36e9ea45cdb0 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.455136 Sep 11 15:24:09.724155 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 436/869] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:09 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:10.054678 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:10.055462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:10.062752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:10.063353 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:10.063854 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:10.064606 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:10.065118 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:10.065634 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:10.205031 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:10.213876 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a62368fb-0c2c-4eab-81ce-81aefa962682 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.162851 Sep 11 15:24:10.215237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 434/870] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:10 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:10.747479 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:10.748302 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:10.756213 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:10.757258 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:10.758011 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:10.759194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:10.759862 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:10.760488 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:10.907531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:10.915585 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e6d09113-6405-4ee5-ac57-19bb5e614826 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.172942 Sep 11 15:24:10.916150 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 437/871] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:10 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:11.238213 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:11.238825 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:11.245878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:11.246353 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:11.247046 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:11.248036 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:11.248840 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:11.249533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:11.396566 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:11.409243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3e707722-f81d-4084-8e38-f85974efaf03 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.175007 Sep 11 15:24:11.421040 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 435/872] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:11 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:11.940844 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:11.941536 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:11.948483 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:11.949118 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:11.949640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:11.950425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:11.951104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:11.951602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:12.090779 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:12.099188 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b3fbcf30-beb9-43c9-96ef-e286eb13fa88 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.162139 Sep 11 15:24:12.099804 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 438/873] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:11 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:12.433871 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:12.434631 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:12.443198 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:12.444077 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:12.444608 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:12.445442 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:12.446115 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:12.446620 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:12.591236 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:12.599984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3d22e1cc-bd68-4554-aa45-f821410e54e4 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.169953 Sep 11 15:24:12.600592 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 436/874] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:12 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:13.123461 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:13.124209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:13.126563 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:13.133094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:13.133610 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:13.134041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:13.134741 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:13.135271 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:13.135756 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:13.298630 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:13.307749 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-41e47100-02f5-4035-9567-c9093df3f7ed tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.188714 Sep 11 15:24:13.308326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 439/875] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:13 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:13.625000 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:13.625676 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:13.628746 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:13.634017 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:13.634846 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:13.635503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:13.636438 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:13.637248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:13.637997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:14.041448 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:14.050033 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6c2d60aa-a4f5-423e-8b4b-79d854b1ae17 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.429651 Sep 11 15:24:14.050818 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 437/876] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:13 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:14.331895 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:14.332499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:14.339803 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:14.340274 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:14.340996 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:14.341955 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:14.342619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:14.343245 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:14.503264 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:14.511993 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3f3680ac-4a7d-4f5b-9084-f9988343bcf3 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.184015 Sep 11 15:24:14.524160 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 440/877] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:14 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:15.073545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:15.074203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:15.081576 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:15.082516 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:15.083239 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:15.084401 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:15.085070 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:15.085851 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:15.231801 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:15.240409 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-af019781-5300-4c7b-a6d6-96c3fd67489b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.170870 Sep 11 15:24:15.254445 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 438/878] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:15 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:15.536378 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:15.537182 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:15.544584 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:15.545063 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:15.545526 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:15.546229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:15.546672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:15.547082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:15.690928 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:15.700404 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-224feea7-9a74-4dd6-93f9-8e244b30c190 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.168134 Sep 11 15:24:15.705589 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 441/879] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:15 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:16.268912 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:16.269575 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:16.277798 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:16.278372 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:16.279490 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:16.279883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:16.280333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:16.280774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:16.413469 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:16.425052 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3cc2fc66-85c3-4dc5-8ff7-cd12443a2f73 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.162184 Sep 11 15:24:16.425897 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 439/880] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:16 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:16.725863 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:16.727119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:16.734597 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:16.735479 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:16.735931 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:16.736627 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:16.737076 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:16.737493 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:16.874152 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:16.888125 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f195a93d-31c7-449c-bc29-7b7cd0e5d2d6 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.167947 Sep 11 15:24:16.888731 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 442/881] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:16 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:17.448401 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:17.449273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:17.451006 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=14 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:17.457707 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:17.458183 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:17.458611 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:17.459300 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:17.459754 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:17.460140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:17.594756 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:17.602749 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-12ea7423-2e54-4a1a-8c8e-16e8c89f1f20 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.158422 Sep 11 15:24:17.603368 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 440/882] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:17 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:17.759580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-547a49b5-b0a4-4d14-bc4d-11ca1269fa23 req-548c4c55-977b-4c58-8d73-86c8cbd76a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e", "tag": "b67d75ac-0f8f-448e-8930-f9983915d917"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:17.769777 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-547a49b5-b0a4-4d14-bc4d-11ca1269fa23 req-548c4c55-977b-4c58-8d73-86c8cbd76a25 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:17.770318 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-547a49b5-b0a4-4d14-bc4d-11ca1269fa23 req-548c4c55-977b-4c58-8d73-86c8cbd76a25 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:17.770760 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-547a49b5-b0a4-4d14-bc4d-11ca1269fa23 req-548c4c55-977b-4c58-8d73-86c8cbd76a25 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:17.782021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-547a49b5-b0a4-4d14-bc4d-11ca1269fa23 req-548c4c55-977b-4c58-8d73-86c8cbd76a25 service nova] Creating event network-changed:b67d75ac-0f8f-448e-8930-f9983915d917 for instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e on hv-cinder-83976 Sep 11 15:24:17.787212 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-547a49b5-b0a4-4d14-bc4d-11ca1269fa23 req-548c4c55-977b-4c58-8d73-86c8cbd76a25 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095590 Sep 11 15:24:17.787811 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 443/883] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:24:17.912838 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:17.913479 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:17.920520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:17.921003 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:17.921470 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:17.922147 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:17.922592 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:17.923006 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:18.069503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:18.077851 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e32e2dd5-67fa-4d26-b3c1-44529d54d886 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.169831 Sep 11 15:24:18.078416 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 441/884] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:17 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:18.627130 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:18.627738 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:18.634435 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:18.634918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:18.635345 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:18.636025 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:18.636470 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:18.636888 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:18.772059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:18.780347 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-46adabcb-13a3-4975-959c-0d31415e1539 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.157706 Sep 11 15:24:18.780921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 444/885] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:18 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:19.101578 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:19.105406 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:19.112499 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:19.112985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:19.113770 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:19.114485 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:19.115040 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:19.115373 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:19.266642 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:19.274955 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1a51e1c1-3f06-42ce-8845-21dbffa9a24a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.177571 Sep 11 15:24:19.277871 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 442/886] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:19 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:19.805286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:19.805960 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:19.815100 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:19.815707 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:19.816221 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:19.817102 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:19.817588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:19.818010 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:19.823269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:19.960895 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:19.969031 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2b90d363-fb4d-40e4-a278-83291cfc05de tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.168301 Sep 11 15:24:19.969659 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 445/887] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:19 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:20.301745 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:20.302357 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:20.309259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:20.309742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:20.310491 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:20.311273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:20.311723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:20.312144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:20.446223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:20.454893 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c4e493b2-f337-4a89-8a97-4ef7dfb60e3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1569 microversion: 2.1 time: 0.157630 Sep 11 15:24:20.455461 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 443/888] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:20 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:20.476951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:20.477499 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:20.483765 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:20.484244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:20.484647 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:20.485496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:20.485946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:20.486361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:20.540675 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120740) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 15:24:20.613905 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ffce27fd-4450-489d-b5c2-f562a0314c8b tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "POST /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0/action" status: 202 len: 0 microversion: 2.1 time: 0.140861 Sep 11 15:24:20.614615 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 446/889] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:24:20 2022] POST /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:24:20.622745 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:20.623364 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:20.629496 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:20.629968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:20.630504 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:20.631152 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:20.631598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:20.632010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:20.797921 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:20.806061 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f648d11d-5aea-4148-a00e-f455e733026f tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1517 microversion: 2.1 time: 0.187115 Sep 11 15:24:20.806816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 444/890] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:20 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:20.992877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:20.993486 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:21.000376 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:21.001423 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:21.001423 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:21.002003 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:21.002448 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:21.002861 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:21.142415 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:21.150527 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aa2887d7-518b-4bb5-8ed4-bad90b815d6a tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.162136 Sep 11 15:24:21.151114 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 447/891] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:20 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:21.831592 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:21.832457 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:21.839827 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:21.840298 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:21.840746 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:21.841516 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:21.841962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:21.842401 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:21.992418 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:22.002110 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-91e7dff2-1934-451e-9cc0-d4522959b4fa tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1519 microversion: 2.1 time: 0.176133 Sep 11 15:24:22.002965 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 445/892] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:21 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:22.177554 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:22.178775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:22.190254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:22.191000 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:22.191709 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:22.192890 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:22.193721 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:22.194490 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:22.346046 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:22.354148 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a574ba55-c489-41b7-928c-86900859c24b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.183944 Sep 11 15:24:22.354739 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 448/893] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:22 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:23.026615 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:23.027496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:23.034061 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:23.034998 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:23.035483 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:23.036230 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:23.036777 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:23.037283 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:23.078650 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-088a602f-7a79-4af9-9a7c-b60b7b829f7e req-9201fa14-8b2f-4aac-b885-42b82ddd6b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d9d4f0-6987-4178-b7ec-3cb415f0ade0", "name": "network-vif-unplugged", "status": "completed", "tag": "d63ce17e-b6af-4eea-a89b-48e0ac5ee02e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:23.089905 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-088a602f-7a79-4af9-9a7c-b60b7b829f7e req-9201fa14-8b2f-4aac-b885-42b82ddd6b1a service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:23.090373 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-088a602f-7a79-4af9-9a7c-b60b7b829f7e req-9201fa14-8b2f-4aac-b885-42b82ddd6b1a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:23.090774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-088a602f-7a79-4af9-9a7c-b60b7b829f7e req-9201fa14-8b2f-4aac-b885-42b82ddd6b1a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:23.104560 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-088a602f-7a79-4af9-9a7c-b60b7b829f7e req-9201fa14-8b2f-4aac-b885-42b82ddd6b1a service nova] Creating event network-vif-unplugged:d63ce17e-b6af-4eea-a89b-48e0ac5ee02e for instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 on hv-cinder-83976 Sep 11 15:24:23.109873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-088a602f-7a79-4af9-9a7c-b60b7b829f7e req-9201fa14-8b2f-4aac-b885-42b82ddd6b1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098711 Sep 11 15:24:23.110464 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 446/894] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:24:23.188983 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:23.197601 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6399b345-ae88-4450-bb41-348b3e381682 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1575 microversion: 2.1 time: 0.175266 Sep 11 15:24:23.198172 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 449/895] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:23 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:23.382303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:23.383306 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:23.392230 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:23.392706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:23.393159 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:23.393868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:23.394310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:23.394729 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:23.539239 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:23.547389 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-67ca8d6f-f348-4136-8b28-caa5e3819754 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.172390 Sep 11 15:24:23.547960 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 447/896] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:23 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:24.221047 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:24.221869 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:24.228524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:24.229004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:24.229441 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:24.230148 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:24.230588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:24.230991 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:24.380938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:24.391721 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6d31c773-79a4-4d4e-aec9-098bcc0a79cc tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1575 microversion: 2.1 time: 0.174588 Sep 11 15:24:24.392291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 450/897] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:24 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:24:24.570881 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:24.571459 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:24.578512 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:24.578992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:24.579420 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:24.580100 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:24.580542 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:24.580957 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:24.727776 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:24.731420 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:24.736587 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2b22994f-9c94-413f-b45a-e1db4fe20c75 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.169643 Sep 11 15:24:24.737170 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 448/898] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:24 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:25.127472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-4b180a91-c6cf-433f-b966-a16425f84e05 req-08be599f-741c-4d1f-a703-c65f60540853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e", "name": "network-vif-plugged", "status": "completed", "tag": "b67d75ac-0f8f-448e-8930-f9983915d917"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:25.141680 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4b180a91-c6cf-433f-b966-a16425f84e05 req-08be599f-741c-4d1f-a703-c65f60540853 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:25.142174 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4b180a91-c6cf-433f-b966-a16425f84e05 req-08be599f-741c-4d1f-a703-c65f60540853 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:25.142599 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4b180a91-c6cf-433f-b966-a16425f84e05 req-08be599f-741c-4d1f-a703-c65f60540853 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:25.154152 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-4b180a91-c6cf-433f-b966-a16425f84e05 req-08be599f-741c-4d1f-a703-c65f60540853 service nova] Creating event network-vif-plugged:b67d75ac-0f8f-448e-8930-f9983915d917 for instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e on hv-cinder-83976 Sep 11 15:24:25.159277 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-4b180a91-c6cf-433f-b966-a16425f84e05 req-08be599f-741c-4d1f-a703-c65f60540853 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037013 Sep 11 15:24:25.159860 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 451/899] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:24:25.417922 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:25.418790 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:25.427850 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:25.428524 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:25.429166 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:25.430172 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:25.430793 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:25.431388 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:25.579022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:25.587146 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c9329daf-9442-48cf-b542-da014b8d1d26 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1575 microversion: 2.1 time: 0.175786 Sep 11 15:24:25.587711 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 449/900] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:25 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:25.763872 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:25.764861 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:25.771749 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:25.772229 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:25.772649 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:25.773367 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:25.773794 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:25.774209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:25.908929 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:25.920264 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-46ec16e4-4ebc-4938-95a7-b0181bb921e3 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1357 microversion: 2.1 time: 0.163684 Sep 11 15:24:25.921079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 452/901] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:25 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:26.611382 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:26.611980 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:26.618737 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:26.619213 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:26.619637 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:26.620317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:26.620759 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:26.621167 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:26.764612 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:26.775795 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2e539319-022f-49a8-ad48-958bf788482c tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1575 microversion: 2.1 time: 0.168469 Sep 11 15:24:26.776427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 450/902] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:26 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:26.944586 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:26.945191 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:26.951901 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:26.952379 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:26.952832 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:26.953555 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:26.953997 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:26.954419 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:27.096727 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:27.105231 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d5bded76-3bb8-49e1-928f-7a0411e202ef tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1547 microversion: 2.1 time: 0.164748 Sep 11 15:24:27.105802 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 453/903] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:26 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:27.127336 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:27.127958 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:27.134294 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:27.134769 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:27.135199 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:27.135888 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:27.136334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:27.136753 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:27.274337 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:27.284560 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b87a5c71-0b3b-48a7-b4c7-63dd93d8831e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1547 microversion: 2.1 time: 0.160855 Sep 11 15:24:27.285405 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 451/904] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:27 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:27.310698 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:27.315547 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:27.316309 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Searching by: {'deleted': False, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862'} {{(pid=120740) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 11 15:24:27.323350 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:27.323820 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:27.324240 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:27.324970 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:27.325447 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:27.325871 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:27.422745 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.multi_cell_list [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120740) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 11 15:24:27.515693 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-21b227ff-4679-4840-9286-ad28ef29e7d8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209056 Sep 11 15:24:27.516254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 454/905] 10.222.0.44 () {58 vars in 1125 bytes} [Sun Sep 11 15:24:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:24:27.534026 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:27.534663 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:27.541073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:27.541594 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:27.542028 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:27.542718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:27.543165 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:27.543586 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:27.689028 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:27.696862 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-42c4a1f9-a809-4c23-9ba0-f5d9210fd9ff tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1547 microversion: 2.1 time: 0.167683 Sep 11 15:24:27.697486 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 452/906] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:27 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:27.800679 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:27.801413 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:27.808144 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:27.808657 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:27.809071 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:27.809782 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:27.810604 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:27.811003 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:27.943474 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:27.952092 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bd0c399e-d37b-4717-bf20-6950cddab079 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1575 microversion: 2.1 time: 0.155374 Sep 11 15:24:27.952914 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 455/907] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:27 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:28.976202 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:28.976808 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:28.983677 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:28.984160 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:28.984591 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:28.985339 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:28.985789 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:28.986209 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:29.124073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:29.133181 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-46a354b1-7c99-4ff0-96f7-e6cbb24d017e tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1575 microversion: 2.1 time: 0.161195 Sep 11 15:24:29.133751 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 453/908] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:28 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:29.280903 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-378dec96-5ff3-416c-a2d7-cc03f08fe26e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d609f731-b0e7-4f78-87e9-ba0c61651866"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:29.283319 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-378dec96-5ff3-416c-a2d7-cc03f08fe26e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:29.290180 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-378dec96-5ff3-416c-a2d7-cc03f08fe26e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:29.290656 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-378dec96-5ff3-416c-a2d7-cc03f08fe26e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:29.291092 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-378dec96-5ff3-416c-a2d7-cc03f08fe26e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:29.291761 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-378dec96-5ff3-416c-a2d7-cc03f08fe26e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:29.292202 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-378dec96-5ff3-416c-a2d7-cc03f08fe26e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:29.292615 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-378dec96-5ff3-416c-a2d7-cc03f08fe26e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:29.712210 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-378dec96-5ff3-416c-a2d7-cc03f08fe26e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "POST /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434772 Sep 11 15:24:29.712995 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 456/909] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 15:24:29 2022] POST /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:24:30.156701 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:30.157586 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:30.164554 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:30.165041 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:30.165497 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:30.166215 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:30.166632 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:30.167048 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:30.309610 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:30.318310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fe4dee4a-4a96-428d-9143-f54634f019d2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1562 microversion: 2.1 time: 0.166261 Sep 11 15:24:30.318934 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 454/910] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:30 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:33.064602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-a0335efe-a3a5-45ae-ab6d-8cfa5b2b7706 req-c64c0714-b14e-4f44-b502-30c9b2557791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d9d4f0-6987-4178-b7ec-3cb415f0ade0", "name": "network-vif-plugged", "status": "completed", "tag": "d63ce17e-b6af-4eea-a89b-48e0ac5ee02e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:33.070310 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:33.078102 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a0335efe-a3a5-45ae-ab6d-8cfa5b2b7706 req-c64c0714-b14e-4f44-b502-30c9b2557791 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:33.078560 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a0335efe-a3a5-45ae-ab6d-8cfa5b2b7706 req-c64c0714-b14e-4f44-b502-30c9b2557791 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:33.078977 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a0335efe-a3a5-45ae-ab6d-8cfa5b2b7706 req-c64c0714-b14e-4f44-b502-30c9b2557791 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:33.094082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-a0335efe-a3a5-45ae-ab6d-8cfa5b2b7706 req-c64c0714-b14e-4f44-b502-30c9b2557791 service nova] Creating event network-vif-plugged:d63ce17e-b6af-4eea-a89b-48e0ac5ee02e for instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 on hv-cinder-83976 Sep 11 15:24:33.099335 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-a0335efe-a3a5-45ae-ab6d-8cfa5b2b7706 req-c64c0714-b14e-4f44-b502-30c9b2557791 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040615 Sep 11 15:24:33.100260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 457/911] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:24:37.344551 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:37.345144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:37.347742 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:37.353781 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:37.354274 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:37.354706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:37.355391 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:37.355843 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:37.356259 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:37.495858 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:37.504551 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5c137e5a-4777-44b6-b351-a98afc044a0b tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1593 microversion: 2.1 time: 0.163963 Sep 11 15:24:37.505119 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 455/912] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:37 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1593 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:24:39.518046 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:24:39.522805 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-e23ebce0-66b3-48ee-9a4b-88333fce5228 req-17f6b50b-f8f7-406b-9751-50e6c3b7d6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e", "tag": "b67d75ac-0f8f-448e-8930-f9983915d917"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:39.533793 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e23ebce0-66b3-48ee-9a4b-88333fce5228 req-17f6b50b-f8f7-406b-9751-50e6c3b7d6ba service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:39.534262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e23ebce0-66b3-48ee-9a4b-88333fce5228 req-17f6b50b-f8f7-406b-9751-50e6c3b7d6ba service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:39.534834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e23ebce0-66b3-48ee-9a4b-88333fce5228 req-17f6b50b-f8f7-406b-9751-50e6c3b7d6ba service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:39.548609 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-e23ebce0-66b3-48ee-9a4b-88333fce5228 req-17f6b50b-f8f7-406b-9751-50e6c3b7d6ba service nova] Creating event network-changed:b67d75ac-0f8f-448e-8930-f9983915d917 for instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e on hv-cinder-83976 Sep 11 15:24:39.553679 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-e23ebce0-66b3-48ee-9a4b-88333fce5228 req-17f6b50b-f8f7-406b-9751-50e6c3b7d6ba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037022 Sep 11 15:24:39.554276 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 458/913] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:24:40.815524 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2139865253"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:40.816113 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:40.823807 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:40.824321 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:40.824750 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:40.825618 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:40.826061 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:40.826472 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:40.958949 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.network.security_group_api [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Adding security group e922b4c9-9ab0-4e21-a32a-217907ea13e9 to port b67d75ac-0f8f-448e-8930-f9983915d917 Sep 11 15:24:41.335462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cef075f8-f9a7-484a-9823-76017de45edf tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "POST /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/action" status: 202 len: 0 microversion: 2.1 time: 0.524780 Sep 11 15:24:41.336310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 456/914] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:24:40 2022] POST /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:24:41.345923 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:24:41.346671 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:24:41.353536 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:41.354291 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:41.354928 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:41.356194 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:41.356912 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:41.358523 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:41.423946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-44ca3551-9826-472c-99ac-3e18178339be req-45ea9ddf-83c7-4ac0-a816-c963efebb190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e", "tag": "b67d75ac-0f8f-448e-8930-f9983915d917"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:24:41.435913 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-44ca3551-9826-472c-99ac-3e18178339be req-45ea9ddf-83c7-4ac0-a816-c963efebb190 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:24:41.436655 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-44ca3551-9826-472c-99ac-3e18178339be req-45ea9ddf-83c7-4ac0-a816-c963efebb190 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:24:41.437078 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-44ca3551-9826-472c-99ac-3e18178339be req-45ea9ddf-83c7-4ac0-a816-c963efebb190 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:24:41.451538 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-44ca3551-9826-472c-99ac-3e18178339be req-45ea9ddf-83c7-4ac0-a816-c963efebb190 service nova] Creating event network-changed:b67d75ac-0f8f-448e-8930-f9983915d917 for instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e on hv-cinder-83976 Sep 11 15:24:41.457002 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-44ca3551-9826-472c-99ac-3e18178339be req-45ea9ddf-83c7-4ac0-a816-c963efebb190 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115340 Sep 11 15:24:41.458358 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 459/915] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:24:41.524875 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:24:41.534067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-23b7e5c9-11c9-4df1-957d-310a8117c44e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1759 microversion: 2.1 time: 0.192147 Sep 11 15:24:41.534730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 457/916] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:24:41 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1759 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:03.857496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dacd2ffc-794d-4da8-9fbf-a875c5c86a44 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:25:03.860650 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dacd2ffc-794d-4da8-9fbf-a875c5c86a44 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:03.864176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=5 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:25:03.864915 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:25:03.873174 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dacd2ffc-794d-4da8-9fbf-a875c5c86a44 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:03.873682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dacd2ffc-794d-4da8-9fbf-a875c5c86a44 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:03.874199 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dacd2ffc-794d-4da8-9fbf-a875c5c86a44 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:03.874790 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dacd2ffc-794d-4da8-9fbf-a875c5c86a44 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:03.875214 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dacd2ffc-794d-4da8-9fbf-a875c5c86a44 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:03.875628 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dacd2ffc-794d-4da8-9fbf-a875c5c86a44 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:03.954315 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dacd2ffc-794d-4da8-9fbf-a875c5c86a44 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "POST /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/action" status: 202 len: 0 microversion: 2.1 time: 0.103326 Sep 11 15:25:03.954951 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 460/917] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:25:03 2022] POST /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:25:03.964306 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:03.964923 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:03.967190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=5 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:25:03.967998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=52 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:25:03.973672 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:03.974253 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:03.974669 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:03.975461 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:03.975901 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:03.976317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:04.129582 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:04.138375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-71d27ded-adba-4c6e-b074-92ad097a6e55 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1751 microversion: 2.1 time: 0.179023 Sep 11 15:25:04.138926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 458/918] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:03 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:05.162911 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:05.163603 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:05.170873 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:05.171354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:05.171760 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:05.172462 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:05.172904 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:05.173358 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:05.331216 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:05.338261 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b01794e0-09f2-42d9-b82a-d6c6cfdaaafe tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.178941 Sep 11 15:25:05.338436 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 461/919] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:05 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:06.369523 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:06.370216 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:06.377966 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:06.378450 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:06.378898 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:06.379602 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:06.380071 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:06.380488 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:06.529894 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:06.539622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1397b5c9-1ddd-4684-a756-93938c0a44b8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.174037 Sep 11 15:25:06.540221 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 459/920] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:06 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:07.566262 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:07.566926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:07.575991 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:07.576471 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:07.576904 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:07.577652 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:07.578079 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:07.578511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:07.730619 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:07.739552 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bf0d86a0-fc5c-47f4-a409-a9b970fd5444 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.179475 Sep 11 15:25:07.740133 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 462/921] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:07 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:08.764526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:08.765198 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:08.772118 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:08.772605 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:08.773074 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:08.773816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:08.774292 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:08.774689 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:08.926073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:08.935085 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e74d781f-2685-4434-9bce-16517d8e9202 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.174702 Sep 11 15:25:08.936007 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 460/922] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:08 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:09.959953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:09.960581 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:09.967939 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:09.968416 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:09.968839 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:09.969832 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:09.970270 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:09.970683 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:10.132048 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:10.140791 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-29400b16-4c8f-4ca8-a5e7-5a40d6712299 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.184698 Sep 11 15:25:10.141376 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 463/923] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:09 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:11.164546 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:11.165221 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:11.172303 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:11.172801 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:11.173274 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:11.173969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:11.174428 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:11.174832 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:11.326243 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:11.335563 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-92a1b810-bc9c-42c0-835c-bc0d74bc1725 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.174996 Sep 11 15:25:11.336250 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 461/924] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:11 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:12.359556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:12.360215 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:12.367274 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:12.367751 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:12.368175 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:12.368858 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:12.369329 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:12.369736 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:12.525388 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:12.534519 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-19ebff34-f6ff-4dda-af4e-d31ac0772415 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.178828 Sep 11 15:25:12.535055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 464/925] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:12 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:13.561929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:13.562565 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:13.569579 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:13.570073 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:13.570497 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:13.571200 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:13.571724 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:13.572111 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:13.751904 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:13.761831 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5fd5a96-9bc1-43cc-978e-c8e3b70f2597 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.204230 Sep 11 15:25:13.762399 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 462/926] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:13 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:14.785699 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:14.786382 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:14.793728 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:14.794210 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:14.795585 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:14.795585 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:14.795811 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:14.796136 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:14.944354 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:14.954524 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5e7dd246-61d7-4562-9564-8c07a4ff4955 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.172464 Sep 11 15:25:14.955082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 465/927] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:14 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:15.981103 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:15.981716 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:15.988983 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:15.989498 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:15.989925 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:15.990628 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:15.991077 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:15.991495 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:16.154962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:16.170506 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dd6f7be4-70b3-4364-adb8-c589566608be tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.193360 Sep 11 15:25:16.171371 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 463/928] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:15 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:17.194177 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:17.194850 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:17.202093 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:17.202580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:17.202992 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:17.203703 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:17.204146 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:17.204540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:17.391877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:17.407476 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-282125b3-609f-43e1-8358-d5b5eab6f748 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.216789 Sep 11 15:25:17.408151 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 466/929] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:17 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:18.432731 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:18.433394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:18.440668 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:18.441172 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:18.441607 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:18.442307 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:18.442769 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:18.443187 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:18.608813 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:18.617728 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d7764ff4-8068-43b9-9721-47911f950d41 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.189855 Sep 11 15:25:18.618312 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 464/930] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:18 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:19.642296 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:19.642926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:19.649796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:19.650270 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:19.650696 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:19.651373 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:19.651818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:19.652228 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:19.804139 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:19.813356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-80c9fac4-e047-46e9-af3e-fd8c62e40d6e tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1756 microversion: 2.1 time: 0.175297 Sep 11 15:25:19.813925 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 467/931] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:19 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:20.842830 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:20.843439 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:20.850088 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:20.850570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:20.851001 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:20.851691 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:20.852135 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:20.852555 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:21.002103 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:21.010707 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-19bcb159-adc4-480b-9bf3-ab80ce4d2b8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1759 microversion: 2.1 time: 0.172606 Sep 11 15:25:21.011249 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 465/932] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:20 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:47.031412 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:47.031963 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:47.034244 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-44cb8032-fd3d-49eb-a791-a8d891da156f req-fd43abd8-0f00-48fe-b99a-539d8adfe1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d9d4f0-6987-4178-b7ec-3cb415f0ade0", "tag": "d63ce17e-b6af-4eea-a89b-48e0ac5ee02e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:25:47.034672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=16 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:25:47.035267 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:25:47.040857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=16 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:25:47.042279 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=48 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:25:47.042531 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:47.043159 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:47.043636 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:47.043957 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 15:25:47.044303 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:47.044530 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Sun Sep 11 15:25:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Sep 11 15:25:47.044838 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:47.045498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:47.054973 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-44cb8032-fd3d-49eb-a791-a8d891da156f req-fd43abd8-0f00-48fe-b99a-539d8adfe1ef service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:47.055575 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-44cb8032-fd3d-49eb-a791-a8d891da156f req-fd43abd8-0f00-48fe-b99a-539d8adfe1ef service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:47.056203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-44cb8032-fd3d-49eb-a791-a8d891da156f req-fd43abd8-0f00-48fe-b99a-539d8adfe1ef service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:47.069262 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-44cb8032-fd3d-49eb-a791-a8d891da156f req-fd43abd8-0f00-48fe-b99a-539d8adfe1ef service nova] Creating event network-changed:d63ce17e-b6af-4eea-a89b-48e0ac5ee02e for instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 on hv-cinder-83976 Sep 11 15:25:47.074784 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-44cb8032-fd3d-49eb-a791-a8d891da156f req-fd43abd8-0f00-48fe-b99a-539d8adfe1ef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044458 Sep 11 15:25:47.075635 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 466/933] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:25:47.075921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:25:47.166648 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-99e4e810-b2ae-4d02-a27d-c4f8fc78ea3d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "DELETE /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 204 len: 0 microversion: 2.1 time: 0.138790 Sep 11 15:25:47.168279 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 468/934] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:25:47 2022] DELETE /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:25:47.176871 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:47.177883 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:47.185047 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:47.186086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:47.186585 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:47.188449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:47.189011 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:47.189526 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:47.345348 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:47.353852 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-731acded-9efa-4eca-9108-7762b5d494d7 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.181368 Sep 11 15:25:47.354734 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 467/935] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:47 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:25:48.378063 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:48.378799 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:48.385722 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:48.386208 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:48.386640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:48.387327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:48.387818 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:48.388228 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:48.525568 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:48.533814 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6f6160b4-282a-4bf5-be12-cb167d04cb7d tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1568 microversion: 2.1 time: 0.159996 Sep 11 15:25:48.534614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 469/936] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:48 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:49.278957 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-7ceb172b-39ef-4ee5-933b-2eac31be9a99 req-b2670a60-8cdf-458c-86b4-39c5d1d9058d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d9d4f0-6987-4178-b7ec-3cb415f0ade0", "name": "network-vif-deleted", "tag": "d63ce17e-b6af-4eea-a89b-48e0ac5ee02e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:25:49.289422 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7ceb172b-39ef-4ee5-933b-2eac31be9a99 req-b2670a60-8cdf-458c-86b4-39c5d1d9058d service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:49.289936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7ceb172b-39ef-4ee5-933b-2eac31be9a99 req-b2670a60-8cdf-458c-86b4-39c5d1d9058d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:49.290355 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7ceb172b-39ef-4ee5-933b-2eac31be9a99 req-b2670a60-8cdf-458c-86b4-39c5d1d9058d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:49.302399 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-7ceb172b-39ef-4ee5-933b-2eac31be9a99 req-b2670a60-8cdf-458c-86b4-39c5d1d9058d service nova] Creating event network-vif-deleted:d63ce17e-b6af-4eea-a89b-48e0ac5ee02e for instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 on hv-cinder-83976 Sep 11 15:25:49.307332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-7ceb172b-39ef-4ee5-933b-2eac31be9a99 req-b2670a60-8cdf-458c-86b4-39c5d1d9058d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032284 Sep 11 15:25:49.307952 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 468/937] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:25:49.556455 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:49.557867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:49.565353 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:49.566407 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:49.566837 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:49.567629 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:49.568240 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:49.568724 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:49.642488 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e253dad57f44ab2955c353792fd5097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3105c3aa57472899713ef172a862e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:49.653067 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-96ca4356-a494-443f-9a28-21cc64ba781a tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 200 len: 1219 microversion: 2.1 time: 0.099898 Sep 11 15:25:49.662004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 470/938] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:49 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:50.680082 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:50.680752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] [instance: 63d9d4f0-6987-4178-b7ec-3cb415f0ade0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:50.689268 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:50.689752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:50.690150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:50.690860 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:50.691300 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:50.691714 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:50.705831 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] HTTP exception thrown: Instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 could not be found. Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Request method failure captured: Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 HTTP/1.1 Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHfz1OiLrblgfQCFyvq9QV9F4qSI7jvzpjm6FhUCJcg9vk-apMgAZkcpp3S9R3nhFSL3dplox8wxh5ZOGyAUZj0gldvX17Ejw1j6VZP2ONOwRqkkq3UsgpcxNf697TQVSToTi0U2fo4v1rJglFtsNDvu5Fxc8thxfs4fAiLtoqvAORUA Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: ae3105c3aa57472899713ef172a862e4 Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestShelveInstance-164838408 Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:25:50.707449 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ae3105c3aa57472899713ef172a862e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ae3105c3aa57472899713ef172a862e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ae3105c3aa57472899713ef172a862e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ae3105c3aa57472899713ef172a862e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestShelveInstance-164838408 Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: ae3105c3aa57472899713ef172a862e4 Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestShelveInstance-164838408 Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-TestShelveInstance-164838408-project Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 6e253dad57f44ab2955c353792fd5097 Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestShelveInstance-164838408-project Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 could not be found. Sep 11 15:25:50.709097 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '63d9d4f0-6987-4178-b7ec-3cb415f0ade0'} Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 could not be found. Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:25:50.710084 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 could not be found. Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 could not be found. Sep 11 15:25:50.711394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:50.712598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Returning 404 to user: Instance 63d9d4f0-6987-4178-b7ec-3cb415f0ade0 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:25:50.712598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cc9f98ab-dd0c-44bf-907b-faa832dbc392 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0" status: 404 len: 111 microversion: 2.1 time: 0.035856 Sep 11 15:25:50.712598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 469/939] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:50 2022] GET /compute/v2.1/servers/63d9d4f0-6987-4178-b7ec-3cb415f0ade0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:25:50.872754 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f3efec31-b0b8-4d5f-8b01-3a1ae6a994a2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] Calling method '.version_select at 0x7f3933e0e550>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:50.893482 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f3efec31-b0b8-4d5f-8b01-3a1ae6a994a2 tempest-TestShelveInstance-164838408 tempest-TestShelveInstance-164838408-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1988693610" status: 202 len: 0 microversion: 2.1 time: 0.024581 Sep 11 15:25:50.894071 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 471/940] 10.222.0.44 () {58 vars in 1254 bytes} [Sun Sep 11 15:25:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1988693610 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 15:25:53.204027 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2139865253"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:25:53.204614 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:53.211317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:53.211810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:53.212237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:53.212934 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:53.213400 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:53.213810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:53.443902 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.network.security_group_api [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Removing security group e922b4c9-9ab0-4e21-a32a-217907ea13e9 from port b67d75ac-0f8f-448e-8930-f9983915d917 Sep 11 15:25:53.938034 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-615480b2-55c8-44e1-980f-27cdea8bdc65 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "POST /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/action" status: 202 len: 0 microversion: 2.1 time: 0.738066 Sep 11 15:25:53.938868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 470/941] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 15:25:53 2022] POST /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/action => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:25:53.952775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-d323da5b-c007-48fb-99ac-efe8805bed08 req-0173abd8-5053-4584-8a91-42ffd2b17461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e", "tag": "b67d75ac-0f8f-448e-8930-f9983915d917"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:25:53.968555 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d323da5b-c007-48fb-99ac-efe8805bed08 req-0173abd8-5053-4584-8a91-42ffd2b17461 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:53.969039 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d323da5b-c007-48fb-99ac-efe8805bed08 req-0173abd8-5053-4584-8a91-42ffd2b17461 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:53.969556 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d323da5b-c007-48fb-99ac-efe8805bed08 req-0173abd8-5053-4584-8a91-42ffd2b17461 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:54.005733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-d323da5b-c007-48fb-99ac-efe8805bed08 req-0173abd8-5053-4584-8a91-42ffd2b17461 service nova] Creating event network-changed:b67d75ac-0f8f-448e-8930-f9983915d917 for instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e on hv-cinder-83976 Sep 11 15:25:54.012804 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-d323da5b-c007-48fb-99ac-efe8805bed08 req-0173abd8-5053-4584-8a91-42ffd2b17461 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064371 Sep 11 15:25:54.014463 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 472/942] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:25:55.283149 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:55.283711 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:55.290295 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:55.290796 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:55.291219 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:55.291930 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:55.292382 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:55.292804 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:55.383019 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lazy-loading 'services' on Instance uuid 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:25:55.476248 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e51bd464-ce09-4b4b-a083-838b75ec69ed tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments/d609f731-b0e7-4f78-87e9-ba0c61651866" status: 202 len: 0 microversion: 2.1 time: 0.198281 Sep 11 15:25:55.477010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 471/943] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:25:55 2022] DELETE /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments/d609f731-b0e7-4f78-87e9-ba0c61651866 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 15:25:55.493921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9784c6e1-97b9-48ec-a8a5-a785ce31b261 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:55.497021 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9784c6e1-97b9-48ec-a8a5-a785ce31b261 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:55.504760 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9784c6e1-97b9-48ec-a8a5-a785ce31b261 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:55.505322 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9784c6e1-97b9-48ec-a8a5-a785ce31b261 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:55.505801 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9784c6e1-97b9-48ec-a8a5-a785ce31b261 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:55.506549 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9784c6e1-97b9-48ec-a8a5-a785ce31b261 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:55.506995 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9784c6e1-97b9-48ec-a8a5-a785ce31b261 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:55.507581 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9784c6e1-97b9-48ec-a8a5-a785ce31b261 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:55.558142 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9784c6e1-97b9-48ec-a8a5-a785ce31b261 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076139 Sep 11 15:25:55.558930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 473/944] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:25:55 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:25:56.032172 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-220689ae-013d-4b42-a3b8-406835ad7f26 req-cd28de0a-60d1-43d4-b639-51fc10359f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e", "tag": "b67d75ac-0f8f-448e-8930-f9983915d917"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:25:56.042753 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-220689ae-013d-4b42-a3b8-406835ad7f26 req-cd28de0a-60d1-43d4-b639-51fc10359f9f service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:56.043144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-220689ae-013d-4b42-a3b8-406835ad7f26 req-cd28de0a-60d1-43d4-b639-51fc10359f9f service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:56.043580 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-220689ae-013d-4b42-a3b8-406835ad7f26 req-cd28de0a-60d1-43d4-b639-51fc10359f9f service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:56.055774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-220689ae-013d-4b42-a3b8-406835ad7f26 req-cd28de0a-60d1-43d4-b639-51fc10359f9f service nova] Creating event network-changed:b67d75ac-0f8f-448e-8930-f9983915d917 for instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e on hv-cinder-83976 Sep 11 15:25:56.062214 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-220689ae-013d-4b42-a3b8-406835ad7f26 req-cd28de0a-60d1-43d4-b639-51fc10359f9f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034019 Sep 11 15:25:56.064422 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 472/945] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:25:56.572038 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7c3bdff7-c357-4486-9b20-28d76191ada1 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:56.574306 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7c3bdff7-c357-4486-9b20-28d76191ada1 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:56.581606 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c3bdff7-c357-4486-9b20-28d76191ada1 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:56.582094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c3bdff7-c357-4486-9b20-28d76191ada1 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:56.582520 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c3bdff7-c357-4486-9b20-28d76191ada1 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:56.583216 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c3bdff7-c357-4486-9b20-28d76191ada1 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:56.583651 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c3bdff7-c357-4486-9b20-28d76191ada1 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:56.584067 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c3bdff7-c357-4486-9b20-28d76191ada1 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:56.615072 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7c3bdff7-c357-4486-9b20-28d76191ada1 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047135 Sep 11 15:25:56.615655 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 474/946] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 15:25:56 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 15:25:56.626979 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:56.627520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:56.634425 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:56.634902 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:56.635333 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:56.636012 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:56.636451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:56.636867 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:56.723390 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] HTTP exception thrown: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e is not attached to volume d609f731-b0e7-4f78-87e9-ba0c61651866 Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Request method failure captured: Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments/d609f731-b0e7-4f78-87e9-ba0c61651866 HTTP/1.1 Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHf2DZgB7C1D0QYeQ97R_JIK2PjJ7EvBfUrrMf4S-donZleaP4V4RbYn-wIPSjbSSEC1Jrx_aSzTCBOj3fJqlg4zzikkB2n9Q_R0Y3r8cjlnxTy-t09YRcsj9vS89FgNk0eGdB_WQxLidZkged5ge2u4vK1sjKk_hqnyZRFbZDruBoK8 Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 5b8c0728fc2e4e54ab90bbce9be73862 Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestMinimumBasicScenario-2112753956 Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:25:56.725859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5b8c0728fc2e4e54ab90bbce9be73862"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5b8c0728fc2e4e54ab90bbce9be73862"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5b8c0728fc2e4e54ab90bbce9be73862"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5b8c0728fc2e4e54ab90bbce9be73862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestMinimumBasicScenario-2112753956 Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 5b8c0728fc2e4e54ab90bbce9be73862 Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2112753956 Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-TestMinimumBasicScenario-2112753956-project Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 53fd875fa50e4bee8bb7cece0efe4e9b Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestMinimumBasicScenario-2112753956-project Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:25:56.728102 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e is not attached to volume d609f731-b0e7-4f78-87e9-ba0c61651866 Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'server_id': '52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e', 'id': 'd609f731-b0e7-4f78-87e9-ba0c61651866'} Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d609f731-b0e7-4f78-87e9-ba0c61651866. Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:25:56.729713 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e is not attached to volume d609f731-b0e7-4f78-87e9-ba0c61651866 Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e is not attached to volume d609f731-b0e7-4f78-87e9-ba0c61651866 Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:25:56.733857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Returning 404 to user: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e is not attached to volume d609f731-b0e7-4f78-87e9-ba0c61651866 {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:25:56.737014 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5396eb99-d87c-4343-a7e5-7dec27ce6738 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments/d609f731-b0e7-4f78-87e9-ba0c61651866" status: 404 len: 154 microversion: 2.1 time: 0.104683 Sep 11 15:25:56.737014 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 473/947] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 15:25:56 2022] DELETE /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e/os-volume_attachments/d609f731-b0e7-4f78-87e9-ba0c61651866 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:25:57.891773 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:57.892434 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:57.899916 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:57.900825 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:57.901377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:57.902176 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:57.902861 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:57.903501 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:57.931273 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:25:58.016637 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bf439f0c-d22e-41f3-9f04-843e0a712137 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 204 len: 0 microversion: 2.1 time: 0.128299 Sep 11 15:25:58.017809 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 475/948] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:25:57 2022] DELETE /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:25:58.026645 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:58.028007 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:58.034878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:58.035351 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:58.035968 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:58.036654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:58.037100 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:58.037544 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:58.178696 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:58.187305 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2adc8aba-12a3-4e76-813c-0d044ff1ad01 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1553 microversion: 2.1 time: 0.164936 Sep 11 15:25:58.188022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 474/949] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:58 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:25:59.210798 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:25:59.211637 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:25:59.218796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:59.219308 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:59.219733 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:59.220449 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:25:59.220876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:25:59.221316 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:25:59.365520 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:25:59.374310 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9ada8e59-ab97-4aa8-99a8-a17ee7c07c8c tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1553 microversion: 2.1 time: 0.167633 Sep 11 15:25:59.375073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 476/950] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:25:59 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:00.247162 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-f4b89675-885b-4c16-a759-f82801bd1511 req-b355c789-aff9-4fb1-935d-f17b7bcd5bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e", "name": "network-vif-deleted", "tag": "b67d75ac-0f8f-448e-8930-f9983915d917"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:26:00.259943 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f4b89675-885b-4c16-a759-f82801bd1511 req-b355c789-aff9-4fb1-935d-f17b7bcd5bac service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:00.260447 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f4b89675-885b-4c16-a759-f82801bd1511 req-b355c789-aff9-4fb1-935d-f17b7bcd5bac service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:00.260842 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f4b89675-885b-4c16-a759-f82801bd1511 req-b355c789-aff9-4fb1-935d-f17b7bcd5bac service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:00.278344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-f4b89675-885b-4c16-a759-f82801bd1511 req-b355c789-aff9-4fb1-935d-f17b7bcd5bac service nova] Creating event network-vif-deleted:b67d75ac-0f8f-448e-8930-f9983915d917 for instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e on hv-cinder-83976 Sep 11 15:26:00.283329 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-f4b89675-885b-4c16-a759-f82801bd1511 req-b355c789-aff9-4fb1-935d-f17b7bcd5bac service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039961 Sep 11 15:26:00.283926 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 475/951] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:26:00.398691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:00.400121 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:00.407254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:00.407730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:00.408152 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:00.408839 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:00.409307 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:00.409851 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:00.443457 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:00.443929 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:00.444352 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:00.444840 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lazy-loading 'fault' on Instance uuid 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:26:00.497554 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fd875fa50e4bee8bb7cece0efe4e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8c0728fc2e4e54ab90bbce9be73862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:00.516590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f1bb03c4-7ff6-48bf-8d0b-ff3ccd297ed8 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 200 len: 1347 microversion: 2.1 time: 0.120570 Sep 11 15:26:00.529455 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 477/952] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:00 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 1347 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:01.545453 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:01.546719 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] [instance: 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:01.553420 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:01.553904 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:01.554342 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:01.555176 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:01.555821 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:01.556429 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:01.571763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] HTTP exception thrown: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e could not be found. Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Request method failure captured: Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e HTTP/1.1 Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHf2DZgB7C1D0QYeQ97R_JIK2PjJ7EvBfUrrMf4S-donZleaP4V4RbYn-wIPSjbSSEC1Jrx_aSzTCBOj3fJqlg4zzikkB2n9Q_R0Y3r8cjlnxTy-t09YRcsj9vS89FgNk0eGdB_WQxLidZkged5ge2u4vK1sjKk_hqnyZRFbZDruBoK8 Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 5b8c0728fc2e4e54ab90bbce9be73862 Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestMinimumBasicScenario-2112753956 Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:26:01.573509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5b8c0728fc2e4e54ab90bbce9be73862"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5b8c0728fc2e4e54ab90bbce9be73862"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5b8c0728fc2e4e54ab90bbce9be73862"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5b8c0728fc2e4e54ab90bbce9be73862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestMinimumBasicScenario-2112753956 Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 5b8c0728fc2e4e54ab90bbce9be73862 Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2112753956 Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-TestMinimumBasicScenario-2112753956-project Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 53fd875fa50e4bee8bb7cece0efe4e9b Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestMinimumBasicScenario-2112753956-project Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e could not be found. Sep 11 15:26:01.575223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e'} Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e could not be found. Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:26:01.576427 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e could not be found. Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e could not be found. Sep 11 15:26:01.577962 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:26:01.580003 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Returning 404 to user: Instance 52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:26:01.580855 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a5dfe6ad-f82b-4f92-837d-6a29bde8d3d0 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e" status: 404 len: 111 microversion: 2.1 time: 0.041519 Sep 11 15:26:01.581804 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 476/953] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:01 2022] GET /compute/v2.1/servers/52ecb2d3-7ff2-4bf5-8ecc-ec0ed49eab2e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:26:01.589830 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f3316118-b6c7-4108-8a5d-bee727bef241 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] Calling method '.version_select at 0x7f3938039d30>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:01.611153 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f3316118-b6c7-4108-8a5d-bee727bef241 tempest-TestMinimumBasicScenario-2112753956 tempest-TestMinimumBasicScenario-2112753956-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-409772676" status: 202 len: 0 microversion: 2.1 time: 0.024982 Sep 11 15:26:01.611806 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 478/954] 10.222.0.44 () {58 vars in 1269 bytes} [Sun Sep 11 15:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-409772676 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 15:26:11.858380 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=22 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:26:11.860704 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:26:12.165276 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-81b04a23-2d66-4ab4-8778-085cfaf02ae9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Action: 'create', calling method: .version_select at 0x7f3933ff7310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1515220714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9zKrZ7/bpTufHmV9J1R9/88hZVj/vFdX9R1ZvLofsVzriTLX6KQ8lCd6+vbs6Ckw+OzNROPbR4DjxOkiBCVRlXHhhGZiHzUkfOFfme2ehgPghIEu595KcDFocndINVxw=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:26:12.181261 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-81b04a23-2d66-4ab4-8778-085cfaf02ae9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Getting quotas for project 521053acc38643e09eb22ead90cd2ba1. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:26:12.185180 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-81b04a23-2d66-4ab4-8778-085cfaf02ae9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Getting quotas for user 0a70540aee424f3896e43e4d6af5c63a and project 521053acc38643e09eb22ead90cd2ba1. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:26:12.217023 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-81b04a23-2d66-4ab4-8778-085cfaf02ae9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.364682 Sep 11 15:26:12.218043 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 477/955] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 15:26:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:26:27.688175 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:26:27.688934 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:26:27.694362 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-456052530", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1515220714", "security_groups": [{"name": "tempest-secgroup-smoke-1422835743"}], "block_device_mapping_v2": [{"uuid": "d9290e37-c58a-4bd7-9d03-2ac19d06b08d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f8238ca-5c6c-4fdd-8cf7-1f58a425087f"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:26:27.829261 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] validate_networks() for [('5f8238ca-5c6c-4fdd-8cf7-1f58a425087f', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:26:28.336941 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:26:28.337402 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:26:28.337874 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:26:28.338274 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:26:28.338703 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:26:28.348365 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:28.348844 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:28.349316 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:28.350069 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:28.350614 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:28.350974 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:28.369071 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Getting quotas for project 521053acc38643e09eb22ead90cd2ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:26:28.373622 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Getting quotas for user 0a70540aee424f3896e43e4d6af5c63a and project 521053acc38643e09eb22ead90cd2ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:26:28.434336 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:26:28.436876 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9290e37-c58a-4bd7-9d03-2ac19d06b08d',volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:26:28.578292 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4a525818-8536-41ce-86a0-b1e16c9f69a4 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891515 Sep 11 15:26:28.578922 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 479/956] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:26:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:26:28.587784 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:26:28.589151 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:26:28.593660 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ddd1e74-0dce-484a-8f13-003b000af543 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:28.595505 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ddd1e74-0dce-484a-8f13-003b000af543 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:28.675852 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ddd1e74-0dce-484a-8f13-003b000af543 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:28.683496 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ddd1e74-0dce-484a-8f13-003b000af543 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1094 microversion: 2.1 time: 0.097024 Sep 11 15:26:28.684067 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 478/957] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:28 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1094 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 15:26:29.706800 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:29.707418 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:29.713994 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:29.714483 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:29.714912 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:29.715628 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:29.716081 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:29.716498 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:29.784546 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:29.793286 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c86e0b32-7951-4c79-94a6-db2ed9edaabd tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1210 microversion: 2.1 time: 0.090931 Sep 11 15:26:29.794204 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 480/958] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:29 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:30.816639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:30.817394 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:30.824296 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:30.824860 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:30.825382 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:30.826147 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:30.826590 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:30.827004 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:30.987385 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:30.995661 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6f451f02-7b03-4ce5-a325-ac58cb92010c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.182903 Sep 11 15:26:30.996270 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 479/959] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:30 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:31.149122 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-140572cb-a1c9-4283-8e66-0035493f4f0d req-c7b2b8dc-256f-4cd1-a1ab-355b197c8e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024ff45c-1b2a-467b-938d-ced19d44409e", "tag": "310f076f-50b4-41ff-b632-1b45d2de7ed7"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:26:31.159247 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-140572cb-a1c9-4283-8e66-0035493f4f0d req-c7b2b8dc-256f-4cd1-a1ab-355b197c8e96 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:31.159725 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-140572cb-a1c9-4283-8e66-0035493f4f0d req-c7b2b8dc-256f-4cd1-a1ab-355b197c8e96 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:31.160146 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-140572cb-a1c9-4283-8e66-0035493f4f0d req-c7b2b8dc-256f-4cd1-a1ab-355b197c8e96 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:31.174716 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-140572cb-a1c9-4283-8e66-0035493f4f0d req-c7b2b8dc-256f-4cd1-a1ab-355b197c8e96 service nova] Creating event network-changed:310f076f-50b4-41ff-b632-1b45d2de7ed7 for instance 024ff45c-1b2a-467b-938d-ced19d44409e on hv-cinder-83976 Sep 11 15:26:31.179630 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-140572cb-a1c9-4283-8e66-0035493f4f0d req-c7b2b8dc-256f-4cd1-a1ab-355b197c8e96 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034202 Sep 11 15:26:31.180248 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 481/960] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:26:32.019271 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:32.019995 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:32.027361 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:32.027852 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:32.028469 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:32.029194 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:32.029639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:32.030060 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:32.177246 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:32.191683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-637ce089-b82f-4f5a-8ad8-364b03f1b6a8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.176113 Sep 11 15:26:32.192684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 480/961] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:32 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:33.218861 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:33.219593 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:33.226798 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:33.227746 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:33.228204 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:33.228925 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:33.229425 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:33.229858 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:33.376588 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:33.385690 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3a09b207-54f5-43f6-bdbb-cf8c11008c52 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.171738 Sep 11 15:26:33.386236 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 482/962] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:33 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:34.408412 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:34.409047 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:34.416494 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:34.416984 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:34.417462 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:34.418169 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:34.418626 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:34.419031 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:34.562169 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:34.573288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1d098564-b56f-4746-b29f-d25919fba0e7 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.168969 Sep 11 15:26:34.574098 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 481/963] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:34 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:35.602062 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:35.602617 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:35.609515 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:35.609993 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:35.610417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:35.611082 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:35.611537 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:35.611953 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:35.764171 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:35.773116 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-37b4d3da-cc5c-4103-ab3f-480b44bdfda8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.176425 Sep 11 15:26:35.773800 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 483/964] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:35 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:36.796654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:36.797299 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:36.806578 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:36.807062 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:36.807492 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:36.808192 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:36.808640 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:36.809061 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:36.946264 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:36.954660 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-df367913-276b-45bc-a0ea-d0c6354c8756 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.162638 Sep 11 15:26:36.955235 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 482/965] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:36 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:37.981037 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:37.981605 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:37.988933 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:37.989444 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:37.990038 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:37.991099 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:37.991757 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:37.992341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:38.140774 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:38.148934 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4fc13de4-18ed-4850-84d2-f168c3ec8c3c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.173125 Sep 11 15:26:38.149555 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 484/966] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:37 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:39.172730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:39.173438 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:39.175857 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:26:39.181837 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:39.182322 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:39.182748 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:39.183448 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:39.183903 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:39.184317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:39.329369 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:39.338234 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-49d4437d-d8d9-45f9-bf13-8c6bfe1f9011 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.169422 Sep 11 15:26:39.338853 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 483/967] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:39 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:40.362720 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:40.363482 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:40.366450 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:26:40.367219 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:26:40.374450 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:40.374919 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:40.375341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:40.376031 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:40.376470 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:40.376879 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:40.528277 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:40.536358 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1d296ab3-8d99-47a5-a372-acf5592de408 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.179261 Sep 11 15:26:40.536933 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 485/968] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:40 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:41.559405 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:41.559997 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:41.566985 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:41.567460 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:41.567889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:41.568570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:41.569018 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:41.569446 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:41.707247 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:41.715796 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2efe53b7-ce39-48c3-bb71-4ed3a5050ba8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.160327 Sep 11 15:26:41.721180 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 484/969] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:41 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:41.721363 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-0283c13c-8c95-464c-a802-a97d5f8a4301 req-af1fb0d0-fb1c-4840-bcb2-b67a960d493d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024ff45c-1b2a-467b-938d-ced19d44409e", "name": "network-vif-plugged", "status": "completed", "tag": "310f076f-50b4-41ff-b632-1b45d2de7ed7"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:26:41.726392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0283c13c-8c95-464c-a802-a97d5f8a4301 req-af1fb0d0-fb1c-4840-bcb2-b67a960d493d service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:41.726925 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0283c13c-8c95-464c-a802-a97d5f8a4301 req-af1fb0d0-fb1c-4840-bcb2-b67a960d493d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:41.727358 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0283c13c-8c95-464c-a802-a97d5f8a4301 req-af1fb0d0-fb1c-4840-bcb2-b67a960d493d service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:41.740055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-0283c13c-8c95-464c-a802-a97d5f8a4301 req-af1fb0d0-fb1c-4840-bcb2-b67a960d493d service nova] Creating event network-vif-plugged:310f076f-50b4-41ff-b632-1b45d2de7ed7 for instance 024ff45c-1b2a-467b-938d-ced19d44409e on hv-cinder-83976 Sep 11 15:26:41.745252 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-0283c13c-8c95-464c-a802-a97d5f8a4301 req-af1fb0d0-fb1c-4840-bcb2-b67a960d493d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032914 Sep 11 15:26:41.745858 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 486/970] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 15:26:42.742398 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:42.743095 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:42.751080 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:42.751637 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:42.752140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:42.752933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:42.753493 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:42.753980 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:42.886941 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:42.899043 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-71712845-24ea-4cd6-9d76-e5006ab5fd5c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1266 microversion: 2.1 time: 0.161249 Sep 11 15:26:42.899868 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 485/971] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:42 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:43.929004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:43.929723 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:43.936934 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:43.937431 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:43.937853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:43.938638 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:43.939059 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:43.939464 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:44.079237 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:44.091283 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-912ba82e-b81c-4baf-b0ec-a7dcc5c223c5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1453 microversion: 2.1 time: 0.167042 Sep 11 15:26:44.092120 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 487/972] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:43 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:44.118144 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:26:44.118788 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:26:44.125726 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:44.126204 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:44.126635 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:44.127317 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:44.127758 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:44.128180 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:44.276834 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:26:44.285118 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2957107d-975e-45eb-835e-02113b958f14 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1453 microversion: 2.1 time: 0.170847 Sep 11 15:26:44.285703 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 486/973] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:26:44 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:26:46.336439 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-0fd58301-5cc9-4072-8521-62b42ef201f2 req-314cb3c2-158f-414a-8a67-9853cd1bf755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024ff45c-1b2a-467b-938d-ced19d44409e", "tag": "310f076f-50b4-41ff-b632-1b45d2de7ed7"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:26:46.347405 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0fd58301-5cc9-4072-8521-62b42ef201f2 req-314cb3c2-158f-414a-8a67-9853cd1bf755 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:26:46.347855 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0fd58301-5cc9-4072-8521-62b42ef201f2 req-314cb3c2-158f-414a-8a67-9853cd1bf755 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:26:46.348512 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0fd58301-5cc9-4072-8521-62b42ef201f2 req-314cb3c2-158f-414a-8a67-9853cd1bf755 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:26:46.363552 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-0fd58301-5cc9-4072-8521-62b42ef201f2 req-314cb3c2-158f-414a-8a67-9853cd1bf755 service nova] Creating event network-changed:310f076f-50b4-41ff-b632-1b45d2de7ed7 for instance 024ff45c-1b2a-467b-938d-ced19d44409e on hv-cinder-83976 Sep 11 15:26:46.368688 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-0fd58301-5cc9-4072-8521-62b42ef201f2 req-314cb3c2-158f-414a-8a67-9853cd1bf755 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036011 Sep 11 15:26:46.369629 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 488/974] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:28:40.614654 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7094827-6dce-4d6a-85bc-8e64a9077fc8] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 11 15:28:40.615334 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=20 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:28:40.615992 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=48 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:28:40.617385 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 11 15:28:40.617586 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Sun Sep 11 15:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e (ip 10.222.0.44) !!! Sep 11 15:28:40.618613 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 15:28:40.618783 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Sun Sep 11 15:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e (ip 10.222.0.44) !!! Sep 11 15:28:40.623343 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:40.623820 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:40.635186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:40.635657 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:40.636093 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:40.636792 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:40.637265 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:40.637683 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:40.663103 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:28:40.746548 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cd9de42b-84c9-4712-b0c7-b8c486d3fec6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "DELETE /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 204 len: 0 microversion: 2.1 time: 0.133757 Sep 11 15:28:40.747155 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 487/975] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:28:40 2022] DELETE /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:28:40.755754 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b8febc3e-4bc6-45ce-82a8-cb77e875d613] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 11 15:28:40.756820 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:28:40.757665 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=44 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:28:40.759507 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 11 15:28:40.759657 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Sun Sep 11 15:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e (ip 10.222.0.44) !!! Sep 11 15:28:40.771826 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:40.772550 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:40.780714 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:40.781228 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:40.781661 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:40.782346 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:40.782793 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:40.783211 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:40.921915 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:40.930088 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fb2ed8a0-3d85-4fd3-8bc4-a765def68874 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1578 microversion: 2.1 time: 0.177440 Sep 11 15:28:40.930676 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 489/976] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:40 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:41.954082 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:41.954739 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:41.964441 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:41.964934 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:41.965402 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:41.966107 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:41.966554 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:41.966973 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:41.975982 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7094827-6dce-4d6a-85bc-8e64a9077fc8] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 36652. Sep 11 15:28:42.114687 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:42.122982 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-593cc832-7c75-4f94-be44-6e1ed1d35bc2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1578 microversion: 2.1 time: 0.173457 Sep 11 15:28:42.123557 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 488/977] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:41 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:43.147009 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:43.148129 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:43.155428 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:43.155950 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:43.156392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:43.157083 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:43.160013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:43.160511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:43.178016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [-] [b8febc3e-4bc6-45ce-82a8-cb77e875d613] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 36660. Sep 11 15:28:43.226800 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:43.235313 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6b8e568c-fbb9-45e9-9969-16c282807659 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 200 len: 1510 microversion: 2.1 time: 0.092538 Sep 11 15:28:43.235943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 490/978] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:43 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:43.420194 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-e94a6574-0c57-4338-81f6-2652c5470f04 req-31366b55-aa18-42ca-bbf7-228b8dea0e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024ff45c-1b2a-467b-938d-ced19d44409e", "name": "network-vif-deleted", "tag": "310f076f-50b4-41ff-b632-1b45d2de7ed7"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:28:43.431022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e94a6574-0c57-4338-81f6-2652c5470f04 req-31366b55-aa18-42ca-bbf7-228b8dea0e1a service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:43.431522 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e94a6574-0c57-4338-81f6-2652c5470f04 req-31366b55-aa18-42ca-bbf7-228b8dea0e1a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:43.431932 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e94a6574-0c57-4338-81f6-2652c5470f04 req-31366b55-aa18-42ca-bbf7-228b8dea0e1a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:43.446099 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-e94a6574-0c57-4338-81f6-2652c5470f04 req-31366b55-aa18-42ca-bbf7-228b8dea0e1a service nova] Creating event network-vif-deleted:310f076f-50b4-41ff-b632-1b45d2de7ed7 for instance 024ff45c-1b2a-467b-938d-ced19d44409e on hv-cinder-83976 Sep 11 15:28:43.452451 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-e94a6574-0c57-4338-81f6-2652c5470f04 req-31366b55-aa18-42ca-bbf7-228b8dea0e1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036611 Sep 11 15:28:43.456288 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 489/979] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:28:44.260369 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:44.260973 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:44.267679 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:44.268152 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:44.268599 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:44.269307 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:44.269740 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:44.270184 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:44.284326 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] HTTP exception thrown: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Request method failure captured: Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e HTTP/1.1 Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHf4Nr-hJy2rg3E0YsDAEB-qSRyeSGDx3SHMsDoqiJ6kTVgNrvWmt8SNjhC6wviEghh5qhJWP61jTqSZw15vg1XXwuTbZu0VWH6fidWOh9SE3j7P1dgBZbJ64o4m9OZLl7IS7Z_MGh6pHbW5VSyk9nmKgv22J1t4cybudl_OD_qpDbV0 Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:28:44.286041 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 0a70540aee424f3896e43e4d6af5c63a Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:28:44.287946 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '024ff45c-1b2a-467b-938d-ced19d44409e'} Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:28:44.289094 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:28:44.291004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:28:44.292417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Returning 404 to user: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:28:44.292417 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b4b9e591-43f5-45d8-b929-fc171a43aa8a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 404 len: 111 microversion: 2.1 time: 0.031299 Sep 11 15:28:44.297477 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 491/980] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:44 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:28:44.340204 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-576729635", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1515220714", "security_groups": [{"name": "tempest-secgroup-smoke-1422835743"}], "block_device_mapping_v2": [{"uuid": "d9290e37-c58a-4bd7-9d03-2ac19d06b08d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f8238ca-5c6c-4fdd-8cf7-1f58a425087f"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:28:44.461892 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] validate_networks() for [('5f8238ca-5c6c-4fdd-8cf7-1f58a425087f', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:28:44.860244 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:28:44.860929 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:28:44.861554 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:28:44.862191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:28:44.862697 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:28:44.876226 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:44.876944 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:44.877520 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:44.878602 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:44.879237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:44.879762 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:44.898584 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Getting quotas for project 521053acc38643e09eb22ead90cd2ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:28:44.902948 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Getting quotas for user 0a70540aee424f3896e43e4d6af5c63a and project 521053acc38643e09eb22ead90cd2ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:28:44.962392 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:28:44.964656 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9290e37-c58a-4bd7-9d03-2ac19d06b08d',volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:28:45.112487 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cf48c0cb-82e7-4320-bbe5-436182937967 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.776686 Sep 11 15:28:45.113168 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 490/981] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:28:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:28:45.124557 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e2dbc0c9-e00c-41e2-a35c-77eb2dd453f5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:45.125335 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e2dbc0c9-e00c-41e2-a35c-77eb2dd453f5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:45.180194 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e2dbc0c9-e00c-41e2-a35c-77eb2dd453f5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:45.188444 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e2dbc0c9-e00c-41e2-a35c-77eb2dd453f5 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1094 microversion: 2.1 time: 0.067870 Sep 11 15:28:45.188999 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 492/982] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:45 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:46.210878 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bbee0b8a-cf88-4605-824b-68f6f5d2b1a0 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:46.212049 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bbee0b8a-cf88-4605-824b-68f6f5d2b1a0 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:46.271580 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bbee0b8a-cf88-4605-824b-68f6f5d2b1a0 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:46.279625 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bbee0b8a-cf88-4605-824b-68f6f5d2b1a0 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1094 microversion: 2.1 time: 0.073157 Sep 11 15:28:46.280351 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 491/983] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:46 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:47.303578 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0217dc7f-31ae-4ee7-ac3c-f1db27f6c5ed tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:47.304575 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0217dc7f-31ae-4ee7-ac3c-f1db27f6c5ed tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:47.360685 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0217dc7f-31ae-4ee7-ac3c-f1db27f6c5ed tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:47.367678 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0217dc7f-31ae-4ee7-ac3c-f1db27f6c5ed tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1094 microversion: 2.1 time: 0.068866 Sep 11 15:28:47.368241 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 493/984] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:47 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:48.392212 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7e6c67ee-c297-4349-89ad-ee27f1b92033 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:48.392969 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7e6c67ee-c297-4349-89ad-ee27f1b92033 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:48.454505 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7e6c67ee-c297-4349-89ad-ee27f1b92033 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:48.467028 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7e6c67ee-c297-4349-89ad-ee27f1b92033 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1094 microversion: 2.1 time: 0.080462 Sep 11 15:28:48.467616 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 492/985] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:48 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:49.493359 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:49.494072 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:49.501997 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:49.502479 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:49.502908 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:49.503594 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:49.504049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:49.504466 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:49.567679 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:49.575765 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-999b3ba2-6128-4858-8150-10a963fade9b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1144 microversion: 2.1 time: 0.087164 Sep 11 15:28:49.579647 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 494/986] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:49 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:50.600132 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:50.600811 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:50.608799 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:50.609325 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:50.609768 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:50.610577 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:50.611105 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:50.611872 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:50.687239 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:50.696363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f2407bc9-ff53-46e0-8f6b-b7bceea9ee1f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1210 microversion: 2.1 time: 0.101586 Sep 11 15:28:50.698501 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 493/987] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:50 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:51.681478 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-2d2a4e8b-8027-4645-a8e4-16dadb34978f req-c99d1683-6628-4f8f-9a68-525056af7ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e2d65d-2648-4d26-b7bd-b0cd337d4ead", "tag": "6c764ceb-e958-4495-aec2-a688238e12da"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:28:51.695028 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2d2a4e8b-8027-4645-a8e4-16dadb34978f req-c99d1683-6628-4f8f-9a68-525056af7ea2 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:51.695503 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2d2a4e8b-8027-4645-a8e4-16dadb34978f req-c99d1683-6628-4f8f-9a68-525056af7ea2 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:51.695930 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2d2a4e8b-8027-4645-a8e4-16dadb34978f req-c99d1683-6628-4f8f-9a68-525056af7ea2 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:51.708664 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-2d2a4e8b-8027-4645-a8e4-16dadb34978f req-c99d1683-6628-4f8f-9a68-525056af7ea2 service nova] Creating event network-changed:6c764ceb-e958-4495-aec2-a688238e12da for instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead on hv-cinder-83976 Sep 11 15:28:51.713642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-2d2a4e8b-8027-4645-a8e4-16dadb34978f req-c99d1683-6628-4f8f-9a68-525056af7ea2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036208 Sep 11 15:28:51.714272 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 495/988] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:28:51.721844 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:51.722454 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:51.729329 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:51.729813 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:51.730230 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:51.730919 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:51.731567 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:51.731976 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:51.866752 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:51.874785 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-13622bb1-4496-4063-8ca5-7cf82369e0e3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.156834 Sep 11 15:28:51.875715 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 494/989] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:51 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:52.902392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:52.903149 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:52.911605 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:52.912091 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:52.912525 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:52.913243 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:52.913691 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:52.914113 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:53.063005 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:53.070947 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5467834e-288a-4c09-a490-dd82beb9ce8f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.174310 Sep 11 15:28:53.071519 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 496/990] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:52 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:54.094092 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:54.094690 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:54.101602 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:54.102082 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:54.102510 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:54.103194 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:54.103645 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:54.104059 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:54.242296 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:54.255223 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-93773b50-d4af-4a4c-921f-8ae226d5d250 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.164716 Sep 11 15:28:54.256331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 495/991] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:54 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:55.282317 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:55.282899 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:55.290145 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:55.290618 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:55.291040 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:55.291716 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:55.292134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:55.292540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:55.431215 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:55.440161 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bab0e488-2629-4bd2-814a-6395ef5e6593 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.161755 Sep 11 15:28:55.440730 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 497/992] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:55 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:56.467468 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:56.468687 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:56.471723 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:28:56.482684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:56.483479 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:56.484203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:56.485393 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:56.486149 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:56.486763 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:56.646925 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:56.659187 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0b7158dd-aac5-4b29-916e-246978b2fe98 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.198474 Sep 11 15:28:56.659758 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 496/993] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:56 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:57.689757 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:57.690375 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:57.692770 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:28:57.700004 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:57.700640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:57.701206 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:57.701955 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:57.702661 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:57.703230 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:57.847784 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:57.859134 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-76683f5f-1d81-4774-9fb4-888694b277b8 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.173916 Sep 11 15:28:57.859871 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 498/994] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:57 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:28:58.882115 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:28:58.882718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:28:58.884937 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=10 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:28:58.890335 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:58.890810 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:58.891237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:58.891922 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:28:58.892362 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:28:58.892774 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:28:59.038183 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:28:59.048010 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-25e7518d-15c9-4304-a882-22ed65e1dd42 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.169944 Sep 11 15:28:59.048632 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 497/995] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:28:58 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:29:00.071073 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:29:00.071684 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:29:00.078640 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:00.079116 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:00.079545 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:00.080232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:00.080673 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:00.081112 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:00.216321 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:29:00.224483 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-995c45f3-04d2-4172-81f5-abccf0ef1a58 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.157313 Sep 11 15:29:00.225104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 499/996] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:29:00 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:29:01.248326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:29:01.248911 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:29:01.256377 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:01.257667 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:01.258249 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:01.259145 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:01.259678 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:01.260117 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:01.403433 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:29:01.411936 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a359f4d4-012e-410e-b134-0f95053ad063 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.167623 Sep 11 15:29:01.412505 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 498/997] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:29:01 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:29:02.220827 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-1e0d4431-7dd5-4388-9250-95e30ae9b3db req-0c25fb65-e5c9-4785-9d3e-263998af02cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e2d65d-2648-4d26-b7bd-b0cd337d4ead", "name": "network-vif-plugged", "status": "completed", "tag": "6c764ceb-e958-4495-aec2-a688238e12da"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:29:02.231018 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-1e0d4431-7dd5-4388-9250-95e30ae9b3db req-0c25fb65-e5c9-4785-9d3e-263998af02cc service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:02.231557 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-1e0d4431-7dd5-4388-9250-95e30ae9b3db req-0c25fb65-e5c9-4785-9d3e-263998af02cc service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:02.231892 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-1e0d4431-7dd5-4388-9250-95e30ae9b3db req-0c25fb65-e5c9-4785-9d3e-263998af02cc service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:02.243717 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-1e0d4431-7dd5-4388-9250-95e30ae9b3db req-0c25fb65-e5c9-4785-9d3e-263998af02cc service nova] Creating event network-vif-plugged:6c764ceb-e958-4495-aec2-a688238e12da for instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead on hv-cinder-83976 Sep 11 15:29:02.249246 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-1e0d4431-7dd5-4388-9250-95e30ae9b3db req-0c25fb65-e5c9-4785-9d3e-263998af02cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032123 Sep 11 15:29:02.249852 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 500/998] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:29:02.434383 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:29:02.435344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:29:02.442412 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:02.442898 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:02.443331 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:02.444048 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:02.444503 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:02.444908 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:02.700490 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:29:02.712767 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c24471f4-c770-4c68-be3b-8286b7285d01 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1266 microversion: 2.1 time: 0.282067 Sep 11 15:29:02.713533 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 499/999] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:29:02 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:29:03.742718 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:29:03.743331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:29:03.750112 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:03.750589 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:03.751019 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:03.751705 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:03.752142 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:03.752567 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:03.946410 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:29:03.954440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-88713acd-2555-45db-a5e0-6554bad12594 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1454 microversion: 2.1 time: 0.217781 Sep 11 15:29:03.955012 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 501/1000] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:29:03 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1454 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:29:03.976512 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:29:03.977086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:29:03.983919 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:03.984398 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:03.984823 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:03.985545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:03.985991 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:03.986407 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:04.126190 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:29:04.135590 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fa01d65b-f541-4902-b643-346258d33cb3 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1454 microversion: 2.1 time: 0.163085 Sep 11 15:29:04.136191 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 500/1001] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:29:03 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:29:06.056028 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-76dbb34d-c197-445a-a8f8-2a8199305102 req-c90746e0-250d-4bfe-8666-b12ef3c7078c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e2d65d-2648-4d26-b7bd-b0cd337d4ead", "tag": "6c764ceb-e958-4495-aec2-a688238e12da"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:29:06.066413 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-76dbb34d-c197-445a-a8f8-2a8199305102 req-c90746e0-250d-4bfe-8666-b12ef3c7078c service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:29:06.066871 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-76dbb34d-c197-445a-a8f8-2a8199305102 req-c90746e0-250d-4bfe-8666-b12ef3c7078c service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:29:06.067287 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-76dbb34d-c197-445a-a8f8-2a8199305102 req-c90746e0-250d-4bfe-8666-b12ef3c7078c service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:29:06.078412 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-76dbb34d-c197-445a-a8f8-2a8199305102 req-c90746e0-250d-4bfe-8666-b12ef3c7078c service nova] Creating event network-changed:6c764ceb-e958-4495-aec2-a688238e12da for instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead on hv-cinder-83976 Sep 11 15:29:06.083200 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-76dbb34d-c197-445a-a8f8-2a8199305102 req-c90746e0-250d-4bfe-8666-b12ef3c7078c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031185 Sep 11 15:29:06.083853 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 502/1002] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:30:43.530897 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:30:43.531829 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:30:43.532536 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 15:30:43.533970 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Sun Sep 11 15:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.44) !!! Sep 11 15:30:43.539239 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-243001731", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1515220714", "security_groups": [{"name": "tempest-secgroup-smoke-1422835743"}], "block_device_mapping_v2": [{"uuid": "1aa38a34-a394-44a5-86c4-10b90432d893", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f8238ca-5c6c-4fdd-8cf7-1f58a425087f"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:30:43.667036 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] validate_networks() for [('5f8238ca-5c6c-4fdd-8cf7-1f58a425087f', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 15:30:44.122175 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 15:30:44.122622 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 15:30:44.123132 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 15:30:44.123571 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 15:30:44.123981 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 15:30:44.134282 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:44.135046 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:44.135720 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:44.136709 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:44.137214 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:44.137639 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:44.155136 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Getting quotas for project 521053acc38643e09eb22ead90cd2ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 15:30:44.158934 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Getting quotas for user 0a70540aee424f3896e43e4d6af5c63a and project 521053acc38643e09eb22ead90cd2ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 15:30:44.218053 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 15:30:44.220794 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1aa38a34-a394-44a5-86c4-10b90432d893',volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 15:30:44.371203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fff81649-8288-44c9-933c-0b1dcfc9e3cc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.841984 Sep 11 15:30:44.371786 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 501/1003] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 15:30:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 15:30:44.381475 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b8febc3e-4bc6-45ce-82a8-cb77e875d613] AMQP server on 10.222.0.44:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 11 15:30:44.382765 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=32 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:30:44.383660 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=56 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:30:44.384952 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 15:30:44.387209 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Sun Sep 11 15:30:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 (ip 10.222.0.44) !!! Sep 11 15:30:44.393823 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9b9a4ea5-75c5-459f-9ad7-75a932b434bf tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:44.394358 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9b9a4ea5-75c5-459f-9ad7-75a932b434bf tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:44.459775 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9b9a4ea5-75c5-459f-9ad7-75a932b434bf tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:44.469763 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9b9a4ea5-75c5-459f-9ad7-75a932b434bf tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1094 microversion: 2.1 time: 0.090434 Sep 11 15:30:44.470578 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 503/1004] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:44 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:45.493545 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:45.494298 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:45.500771 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:45.501280 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:45.501677 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:45.502556 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:45.503203 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:45.503651 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:45.599278 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:45.608332 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7dc32ca3-94ae-438e-b2e0-18d1a885ad83 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1200 microversion: 2.1 time: 0.120105 Sep 11 15:30:45.623946 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 502/1005] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:45 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1200 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:46.631378 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:46.632013 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:46.639982 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:46.640465 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:46.641119 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:46.641834 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:46.642508 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:46.643122 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:46.686068 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [-] [b8febc3e-4bc6-45ce-82a8-cb77e875d613] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 36842. Sep 11 15:30:46.799984 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:46.820275 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-88e2d3ed-ff33-439d-bcbb-837aead55e0f tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.192810 Sep 11 15:30:46.821310 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 504/1006] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:46 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:47.193324 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-ce646a9f-323f-44f3-9221-423dde8ff942 req-911ecbe1-aadb-4c8d-95d2-dfbb83a8f432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59921259-530a-4977-948e-a0bcb85a20b1", "tag": "07ead797-5234-4ae3-8e7d-3f73ab53d869"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:30:47.203305 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ce646a9f-323f-44f3-9221-423dde8ff942 req-911ecbe1-aadb-4c8d-95d2-dfbb83a8f432 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:47.203998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ce646a9f-323f-44f3-9221-423dde8ff942 req-911ecbe1-aadb-4c8d-95d2-dfbb83a8f432 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:47.204437 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ce646a9f-323f-44f3-9221-423dde8ff942 req-911ecbe1-aadb-4c8d-95d2-dfbb83a8f432 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:47.216057 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-ce646a9f-323f-44f3-9221-423dde8ff942 req-911ecbe1-aadb-4c8d-95d2-dfbb83a8f432 service nova] Creating event network-changed:07ead797-5234-4ae3-8e7d-3f73ab53d869 for instance 59921259-530a-4977-948e-a0bcb85a20b1 on hv-cinder-83976 Sep 11 15:30:47.221216 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-ce646a9f-323f-44f3-9221-423dde8ff942 req-911ecbe1-aadb-4c8d-95d2-dfbb83a8f432 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108751 Sep 11 15:30:47.221808 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 503/1007] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:30:47.844363 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:47.844943 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:47.851938 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:47.852424 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:47.852849 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:47.853609 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:47.854054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:47.854467 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:47.994370 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:48.004389 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-786288b6-2162-47df-b604-fd630d9d60be tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.164017 Sep 11 15:30:48.005125 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 505/1008] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:47 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:49.028350 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:49.029797 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:49.036550 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:49.037020 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:49.037502 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:49.038186 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:49.038808 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:49.039237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:49.182326 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:49.191314 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c544687b-4bd1-4b35-8773-79fe8d342e93 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.167511 Sep 11 15:30:49.191970 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 504/1009] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:49 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:50.218132 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:50.218767 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:50.231792 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:50.232651 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:50.233368 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:50.234513 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:50.235254 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:50.235909 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:50.381890 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:50.389697 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-718cca43-4f4d-4784-863b-94df812a920a tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.178201 Sep 11 15:30:50.390261 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 506/1010] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:50 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:51.412889 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:51.413598 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:51.420650 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:51.421149 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:51.421582 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:51.422273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:51.422722 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:51.423137 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:51.561509 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:51.572720 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-aef81249-ccda-430c-81d5-765f3f53c59c tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.163836 Sep 11 15:30:51.573501 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 505/1011] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:51 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:52.595975 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:52.596642 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:52.603747 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:52.604175 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:52.604596 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:52.605456 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:52.605773 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:52.606183 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:52.748657 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:52.757074 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7bf8a761-9312-4248-be33-eb4a74619b75 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.165097 Sep 11 15:30:52.757695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 507/1012] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:52 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:53.780379 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:53.781022 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:53.787879 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:53.788363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:53.788801 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:53.789570 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:53.790000 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:53.790410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:53.941743 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:53.950412 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4b360658-c1ed-47ab-93d4-3a39c640c9fe tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.173873 Sep 11 15:30:53.950901 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 506/1013] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:53 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:54.974138 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:54.974766 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:54.977215 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:30:54.982967 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:54.983580 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:54.983867 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:54.984576 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:54.985092 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:54.985551 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:55.134695 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:55.142988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b814d45e-47d1-4f5e-86de-a6e776307789 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.173241 Sep 11 15:30:55.143868 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 508/1014] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:54 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:56.166506 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:56.167170 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:56.169169 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:30:56.169844 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:30:56.176761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:56.177315 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:56.177750 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:56.178458 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:56.178910 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:56.179321 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:56.319429 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:56.327383 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c48be062-6cea-482f-99bb-50c2ca045f10 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.164859 Sep 11 15:30:56.327945 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 507/1015] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:56 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:56.932017 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-78d75403-597a-4f22-a22f-b9c940df7a2f req-14966e13-7129-4f34-86e9-5ab8dc3fd290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59921259-530a-4977-948e-a0bcb85a20b1", "name": "network-vif-plugged", "status": "completed", "tag": "07ead797-5234-4ae3-8e7d-3f73ab53d869"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:30:56.943682 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-78d75403-597a-4f22-a22f-b9c940df7a2f req-14966e13-7129-4f34-86e9-5ab8dc3fd290 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:56.944168 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-78d75403-597a-4f22-a22f-b9c940df7a2f req-14966e13-7129-4f34-86e9-5ab8dc3fd290 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:56.944590 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-78d75403-597a-4f22-a22f-b9c940df7a2f req-14966e13-7129-4f34-86e9-5ab8dc3fd290 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:56.958576 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-78d75403-597a-4f22-a22f-b9c940df7a2f req-14966e13-7129-4f34-86e9-5ab8dc3fd290 service nova] Creating event network-vif-plugged:07ead797-5234-4ae3-8e7d-3f73ab53d869 for instance 59921259-530a-4977-948e-a0bcb85a20b1 on hv-cinder-83976 Sep 11 15:30:56.963993 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-78d75403-597a-4f22-a22f-b9c940df7a2f req-14966e13-7129-4f34-86e9-5ab8dc3fd290 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109679 Sep 11 15:30:56.964774 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 509/1016] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:30:57.349477 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:57.350124 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:57.357035 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:57.357552 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:57.357986 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:57.358684 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:57.359127 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:57.359547 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:57.507648 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:57.515864 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bdd10fcb-a4bb-4a20-af76-2795dd43604b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1266 microversion: 2.1 time: 0.170363 Sep 11 15:30:57.516421 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 508/1017] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:57 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:58.540335 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:58.541085 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:58.548205 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:58.548675 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:58.549369 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:58.550347 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:58.550830 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:58.551250 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:58.695926 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:58.704043 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fde59075-6612-4a52-a8f6-5d18c5762587 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1454 microversion: 2.1 time: 0.168404 Sep 11 15:30:58.704620 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 510/1018] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:58 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:30:58.726389 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:30:58.727107 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:30:58.734134 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:58.734620 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:58.735048 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:58.735739 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:30:58.736192 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:30:58.736600 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:30:58.881237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:30:58.889736 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5d2ef6ee-473d-4191-bc9c-1ed1c20072bc tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1454 microversion: 2.1 time: 0.167441 Sep 11 15:30:58.890270 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 509/1019] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:30:58 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:31:00.642899 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-f458f9b1-2bb7-4759-9a28-5f213da5daf9 req-9ce0d2c8-abd7-410b-99cf-693a1b85162a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59921259-530a-4977-948e-a0bcb85a20b1", "tag": "07ead797-5234-4ae3-8e7d-3f73ab53d869"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:31:00.652761 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f458f9b1-2bb7-4759-9a28-5f213da5daf9 req-9ce0d2c8-abd7-410b-99cf-693a1b85162a service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:31:00.653269 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f458f9b1-2bb7-4759-9a28-5f213da5daf9 req-9ce0d2c8-abd7-410b-99cf-693a1b85162a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:31:00.654143 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f458f9b1-2bb7-4759-9a28-5f213da5daf9 req-9ce0d2c8-abd7-410b-99cf-693a1b85162a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:31:00.665373 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-f458f9b1-2bb7-4759-9a28-5f213da5daf9 req-9ce0d2c8-abd7-410b-99cf-693a1b85162a service nova] Creating event network-changed:07ead797-5234-4ae3-8e7d-3f73ab53d869 for instance 59921259-530a-4977-948e-a0bcb85a20b1 on hv-cinder-83976 Sep 11 15:31:00.671054 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-f458f9b1-2bb7-4759-9a28-5f213da5daf9 req-9ce0d2c8-abd7-410b-99cf-693a1b85162a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087333 Sep 11 15:31:00.671676 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 511/1020] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:32:30.030065 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:32:30.031202 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=46 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:32:30.036180 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:30.036366 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-73f7b37c-b652-4f85-b4a0-4715508ae770 req-058c28ae-fd03-450f-83dc-2706d942744a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59921259-530a-4977-948e-a0bcb85a20b1", "tag": "07ead797-5234-4ae3-8e7d-3f73ab53d869"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:32:30.036816 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:30.041602 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=20 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:32:30.042514 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=40 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:32:30.043521 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 15:32:30.043662 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Sun Sep 11 15:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Sep 11 15:32:30.045345 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:30.045884 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:30.046490 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:30.047458 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:30.047912 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:30.048345 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:30.060356 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-73f7b37c-b652-4f85-b4a0-4715508ae770 req-058c28ae-fd03-450f-83dc-2706d942744a service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:30.060918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-73f7b37c-b652-4f85-b4a0-4715508ae770 req-058c28ae-fd03-450f-83dc-2706d942744a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:30.061566 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-73f7b37c-b652-4f85-b4a0-4715508ae770 req-058c28ae-fd03-450f-83dc-2706d942744a service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:30.073671 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-73f7b37c-b652-4f85-b4a0-4715508ae770 req-058c28ae-fd03-450f-83dc-2706d942744a service nova] Creating event network-changed:07ead797-5234-4ae3-8e7d-3f73ab53d869 for instance 59921259-530a-4977-948e-a0bcb85a20b1 on hv-cinder-83976 Sep 11 15:32:30.076235 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:32:30.079496 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-73f7b37c-b652-4f85-b4a0-4715508ae770 req-058c28ae-fd03-450f-83dc-2706d942744a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048766 Sep 11 15:32:30.080049 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 512/1021] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:32:30.165718 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3a8b2347-a93d-497e-af08-0c6ced3b3c3b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "DELETE /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 204 len: 0 microversion: 2.1 time: 0.137559 Sep 11 15:32:30.175551 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:30.176239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:30.179577 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 510/1022] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:32:30 2022] DELETE /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:32:30.183188 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:30.183665 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:30.184084 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:30.184779 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:30.185232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:30.185639 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:30.336790 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:32:30.344781 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f440e447-f91d-4afa-a3f0-9b1c61671881 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1579 microversion: 2.1 time: 0.173431 Sep 11 15:32:30.345392 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 513/1023] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:32:30 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1579 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:32:31.370555 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:31.371227 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:31.380008 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:31.380693 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:31.381363 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:31.382173 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:31.382859 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:31.383413 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:31.527344 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:32:31.535709 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9510fffc-ec82-489a-81e3-dcef45b3bde2 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1579 microversion: 2.1 time: 0.170655 Sep 11 15:32:31.536283 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 511/1024] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:32:31 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:32:32.163120 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-f0693e05-9921-435b-920e-d57d0c179041 req-a659878c-adf0-40bf-b2c0-eeb629ef7280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59921259-530a-4977-948e-a0bcb85a20b1", "name": "network-vif-deleted", "tag": "07ead797-5234-4ae3-8e7d-3f73ab53d869"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:32:32.173890 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f0693e05-9921-435b-920e-d57d0c179041 req-a659878c-adf0-40bf-b2c0-eeb629ef7280 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:32.174361 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f0693e05-9921-435b-920e-d57d0c179041 req-a659878c-adf0-40bf-b2c0-eeb629ef7280 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:32.174796 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f0693e05-9921-435b-920e-d57d0c179041 req-a659878c-adf0-40bf-b2c0-eeb629ef7280 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:32.187575 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-f0693e05-9921-435b-920e-d57d0c179041 req-a659878c-adf0-40bf-b2c0-eeb629ef7280 service nova] Creating event network-vif-deleted:07ead797-5234-4ae3-8e7d-3f73ab53d869 for instance 59921259-530a-4977-948e-a0bcb85a20b1 on hv-cinder-83976 Sep 11 15:32:32.192984 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-f0693e05-9921-435b-920e-d57d0c179041 req-a659878c-adf0-40bf-b2c0-eeb629ef7280 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033453 Sep 11 15:32:32.193877 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 514/1025] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:32:32.559273 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:32.559899 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:32.567829 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:32.568469 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:32.569021 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:32.570080 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:32.570626 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:32.571161 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:32.605460 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:32.605966 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:32.606433 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:32.606873 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lazy-loading 'fault' on Instance uuid 59921259-530a-4977-948e-a0bcb85a20b1 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 15:32:32.649825 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:32:32.659577 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e53178ff-25b4-4459-beff-aa710d972f24 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 200 len: 1230 microversion: 2.1 time: 0.104517 Sep 11 15:32:32.660140 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 512/1026] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:32:32 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:32:33.688776 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:33.689750 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 59921259-530a-4977-948e-a0bcb85a20b1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:33.700143 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:33.700907 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:33.701616 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:33.702702 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:33.703578 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:33.704001 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:33.717905 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] HTTP exception thrown: Instance 59921259-530a-4977-948e-a0bcb85a20b1 could not be found. Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Request method failure captured: Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 HTTP/1.1 Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHf4Nr-hJy2rg3E0YsDAEB-qSRyeSGDx3SHMsDoqiJ6kTVgNrvWmt8SNjhC6wviEghh5qhJWP61jTqSZw15vg1XXwuTbZu0VWH6fidWOh9SE3j7P1dgBZbJ64o4m9OZLl7IS7Z_MGh6pHbW5VSyk9nmKgv22J1t4cybudl_OD_qpDbV0 Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:32:33.720440 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 0a70540aee424f3896e43e4d6af5c63a Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 59921259-530a-4977-948e-a0bcb85a20b1 could not be found. Sep 11 15:32:33.722331 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '59921259-530a-4977-948e-a0bcb85a20b1'} Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59921259-530a-4977-948e-a0bcb85a20b1 could not be found. Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:32:33.723472 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59921259-530a-4977-948e-a0bcb85a20b1 could not be found. Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59921259-530a-4977-948e-a0bcb85a20b1 could not be found. Sep 11 15:32:33.725327 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:33.726814 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Returning 404 to user: Instance 59921259-530a-4977-948e-a0bcb85a20b1 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:32:33.726814 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-36952561-53b8-432d-8540-b16c5ebb3477 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1" status: 404 len: 111 microversion: 2.1 time: 0.041379 Sep 11 15:32:33.726814 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 515/1027] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:32:33 2022] GET /compute/v2.1/servers/59921259-530a-4977-948e-a0bcb85a20b1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:32:36.897955 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:36.898904 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-379827df-8a96-4636-8f6c-33ad9522f2dd req-52e5d7e2-9f04-41ef-923a-a7aeb949d341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e2d65d-2648-4d26-b7bd-b0cd337d4ead", "tag": "6c764ceb-e958-4495-aec2-a688238e12da"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:32:36.899369 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:36.906092 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:36.906580 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:36.907004 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:36.908076 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:36.908726 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:36.909378 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:36.910348 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-379827df-8a96-4636-8f6c-33ad9522f2dd req-52e5d7e2-9f04-41ef-923a-a7aeb949d341 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:36.910847 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-379827df-8a96-4636-8f6c-33ad9522f2dd req-52e5d7e2-9f04-41ef-923a-a7aeb949d341 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:36.911296 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-379827df-8a96-4636-8f6c-33ad9522f2dd req-52e5d7e2-9f04-41ef-923a-a7aeb949d341 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:36.923494 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-379827df-8a96-4636-8f6c-33ad9522f2dd req-52e5d7e2-9f04-41ef-923a-a7aeb949d341 service nova] Creating event network-changed:6c764ceb-e958-4495-aec2-a688238e12da for instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead on hv-cinder-83976 Sep 11 15:32:36.928628 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-379827df-8a96-4636-8f6c-33ad9522f2dd req-52e5d7e2-9f04-41ef-923a-a7aeb949d341 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033340 Sep 11 15:32:36.929891 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 516/1028] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:32:36.940368 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 15:32:37.029731 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bcff08c5-f44e-4adc-975a-8a208fab5112 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "DELETE /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 204 len: 0 microversion: 2.1 time: 0.135196 Sep 11 15:32:37.030410 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 513/1029] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:32:36 2022] DELETE /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 15:32:37.040293 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:37.040992 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:37.048231 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:37.048710 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:37.049363 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:37.050062 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:37.050509 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:37.050924 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:37.190988 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:32:37.199244 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7190325a-e81a-4067-9df0-8258842fd626 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1578 microversion: 2.1 time: 0.163295 Sep 11 15:32:37.213500 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 517/1030] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:32:37 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:32:38.224366 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:38.224366 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:38.232485 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:38.233266 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:38.233923 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:38.234980 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:38.235821 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:38.236150 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:38.377659 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:32:38.386237 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-20cb06e1-f730-419d-89f9-987e6d87ca45 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1578 microversion: 2.1 time: 0.167052 Sep 11 15:32:38.386795 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 514/1031] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:32:38 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:32:39.251402 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-cac9ae6a-bb5b-47e8-9fce-e77d68819d28 req-e2890563-1a2d-4d69-a11b-890a1f855e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e2d65d-2648-4d26-b7bd-b0cd337d4ead", "name": "network-vif-deleted", "tag": "6c764ceb-e958-4495-aec2-a688238e12da"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 15:32:39.262368 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-cac9ae6a-bb5b-47e8-9fce-e77d68819d28 req-e2890563-1a2d-4d69-a11b-890a1f855e79 service nova] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:39.263232 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-cac9ae6a-bb5b-47e8-9fce-e77d68819d28 req-e2890563-1a2d-4d69-a11b-890a1f855e79 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:39.264016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-cac9ae6a-bb5b-47e8-9fce-e77d68819d28 req-e2890563-1a2d-4d69-a11b-890a1f855e79 service nova] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:39.275797 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-cac9ae6a-bb5b-47e8-9fce-e77d68819d28 req-e2890563-1a2d-4d69-a11b-890a1f855e79 service nova] Creating event network-vif-deleted:6c764ceb-e958-4495-aec2-a688238e12da for instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead on hv-cinder-83976 Sep 11 15:32:39.281277 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-cac9ae6a-bb5b-47e8-9fce-e77d68819d28 req-e2890563-1a2d-4d69-a11b-890a1f855e79 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033794 Sep 11 15:32:39.281868 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 518/1032] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 15:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 15:32:39.409704 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:39.410319 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:39.416998 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:39.417527 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:39.417974 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:39.418737 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:39.419087 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:39.419483 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:39.485825 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a70540aee424f3896e43e4d6af5c63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521053acc38643e09eb22ead90cd2ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 15:32:39.493933 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cf13e630-2684-464b-87b9-588c1c4aa938 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 200 len: 1225 microversion: 2.1 time: 0.088304 Sep 11 15:32:39.494730 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 515/1033] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:32:39 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 15:32:40.520291 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:40.521022 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 74e2d65d-2648-4d26-b7bd-b0cd337d4ead] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:40.529239 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:40.529690 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:40.530260 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:40.531329 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:40.531751 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:40.532188 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:40.549299 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] HTTP exception thrown: Instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead could not be found. Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Request method failure captured: Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead HTTP/1.1 Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHf4Nr-hJy2rg3E0YsDAEB-qSRyeSGDx3SHMsDoqiJ6kTVgNrvWmt8SNjhC6wviEghh5qhJWP61jTqSZw15vg1XXwuTbZu0VWH6fidWOh9SE3j7P1dgBZbJ64o4m9OZLl7IS7Z_MGh6pHbW5VSyk9nmKgv22J1t4cybudl_OD_qpDbV0 Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:32:40.550949 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 0a70540aee424f3896e43e4d6af5c63a Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead could not be found. Sep 11 15:32:40.552511 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '74e2d65d-2648-4d26-b7bd-b0cd337d4ead'} Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead could not be found. Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:32:40.553377 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead could not be found. Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead could not be found. Sep 11 15:32:40.554708 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:40.555918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Returning 404 to user: Instance 74e2d65d-2648-4d26-b7bd-b0cd337d4ead could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:32:40.555918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-00111466-6ead-457f-a82d-bdf27bb02ec9 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead" status: 404 len: 111 microversion: 2.1 time: 0.037985 Sep 11 15:32:40.555918 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 519/1034] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:32:40 2022] GET /compute/v2.1/servers/74e2d65d-2648-4d26-b7bd-b0cd337d4ead => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:32:41.021116 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:41.021691 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:41.029107 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:41.029653 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:41.030079 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:41.030761 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:41.031202 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:41.031619 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:41.045426 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] HTTP exception thrown: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Request method failure captured: Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e HTTP/1.1 Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Connection: close Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Host: 10.222.0.44 Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjHf4Nr-hJy2rg3E0YsDAEB-qSRyeSGDx3SHMsDoqiJ6kTVgNrvWmt8SNjhC6wviEghh5qhJWP61jTqSZw15vg1XXwuTbZu0VWH6fidWOh9SE3j7P1dgBZbJ64o4m9OZLl7IS7Z_MGh6pHbW5VSyk9nmKgv22J1t4cybudl_OD_qpDbV0 Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Role: reader,member Sep 11 15:32:41.047086 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Roles: reader,member Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Id: 0a70540aee424f3896e43e4d6af5c63a Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: method: > Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: exception: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.049171 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: action_args: {'id': '024ff45c-1b2a-467b-938d-ced19d44409e'} Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:32:41.050042 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.051375 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.052706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Returning 404 to user: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:32:41.052706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3e759d1e-b1ca-4bd1-9bfb-2a22fe68e442 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "DELETE /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 404 len: 111 microversion: 2.1 time: 0.031415 Sep 11 15:32:41.052706 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 516/1035] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 15:32:41 2022] DELETE /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:32:41.057781 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:41.058397 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] [instance: 024ff45c-1b2a-467b-938d-ced19d44409e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 15:32:41.064451 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:41.064921 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:41.065384 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:41.066092 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Acquiring lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 15:32:41.066540 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 15:32:41.067016 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Lock "e60759ca-dd72-43ee-a0ab-eedd3bf86111" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 15:32:41.080774 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] HTTP exception thrown: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Request method failure captured: Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e HTTP/1.1 Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Connection: close Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Host: 10.222.0.44 Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjHf4Nr-hJy2rg3E0YsDAEB-qSRyeSGDx3SHMsDoqiJ6kTVgNrvWmt8SNjhC6wviEghh5qhJWP61jTqSZw15vg1XXwuTbZu0VWH6fidWOh9SE3j7P1dgBZbJ64o4m9OZLl7IS7Z_MGh6pHbW5VSyk9nmKgv22J1t4cybudl_OD_qpDbV0 Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 11 15:32:41.082341 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/521053acc38643e09eb22ead90cd2ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 521053acc38643e09eb22ead90cd2ba1 Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-TestVolumeBootPattern-1766783072 Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Id: 0a70540aee424f3896e43e4d6af5c63a Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-TestVolumeBootPattern-1766783072-project Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: method: > Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: exception: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.084055 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: action_args: {'id': '024ff45c-1b2a-467b-938d-ced19d44409e'} Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 15:32:41.085104 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. Sep 11 15:32:41.086672 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 11 15:32:41.088141 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Returning 404 to user: Instance 024ff45c-1b2a-467b-938d-ced19d44409e could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 15:32:41.088141 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-71fa2a5b-d47c-44db-acf0-8b7165c4667b tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e" status: 404 len: 111 microversion: 2.1 time: 0.030163 Sep 11 15:32:41.088141 dv-cinder-839768-7-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 520/1036] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 15:32:41 2022] GET /compute/v2.1/servers/024ff45c-1b2a-467b-938d-ced19d44409e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 15:32:42.406310 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6e4fdf27-6b7f-4db3-9f3a-05b3f2accac6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] Calling method '.version_select at 0x7f39382dbaf0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 15:32:42.433976 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6e4fdf27-6b7f-4db3-9f3a-05b3f2accac6 tempest-TestVolumeBootPattern-1766783072 tempest-TestVolumeBootPattern-1766783072-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1515220714" status: 202 len: 0 microversion: 2.1 time: 0.031569 Sep 11 15:32:42.434569 dv-cinder-839768-7-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 517/1037] 10.222.0.44 () {58 vars in 1263 bytes} [Sun Sep 11 15:32:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1515220714 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)